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Preface 

Salomi Papadima-Sophocleous 1 


With EUROCALL reaching its 23rd year, it has truly earned its status as an 
innovative conference with a mind of its own - a thought-provoking scientific 
gathering with high aspirations for the future. This is what we have tried to reflect 
in this volume of selected short papers. Short papers are an ideal forum for work in 
progress and late breaking results. As such, this volume captures exactly what CALL 
Communities and Culture represent: papers that are all trying to say something new 
and different, whether at a theoretical and practical level or in terms of research 
carried out in non-traditional areas or using novel methodologies. 

The 23rd EUROCALL conference was organised by the Cyprus University of 
Technology Language Centre - the first time that EUROCALL has been held in 
Cyprus. More than 260 delegates representing 37 different countries attended the 
conference held between 24th and 27th August 2016. 

The theme of the conference this year was CALL Communities and Culture. It 
offered a unique opportunity to hear from real-world CALL practitioners on 
how they practise CALL in their communities, and how the CALL culture has 
developed in local and global contexts. CALL has moved from traditional drill- 
and-practice programmes in the 1960s and 1970s to more recent manifestations 
of CALL, such as the use of interactive whiteboards, corpora and concordances, 
computer-mediated communication as well as the applications used in virtual 
learning environments and e-leaming, virtual worlds, gaming and mobile-assisted 
language learning. Keeping an eye on the latest changes and on the future and 
being well informed are critical success factors for the CALL community. 

Over 135 presentations were delivered and 27 posters were presented on topics 
related specifically to the theme and more general CALL topics. 84 of these appear 
in this volume. 


Cyprus University of Technology, Limassol, Cyprus; salomi.papadima@cut.ac.cy 
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org/10.14705/rpnet.2016.eurocall2016.527 
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Preface 


Our keynote speakers, who came from both within and outside the sphere of 
CALL, contributed greatly to fostering a greater understanding of how we might 
conceptualise CALL Communities and Culture, that is, the different angles we can 
view communities and culture within CALL practice and research. Looking into 
different CALL communities and cultures, building new ones and exploring their 
possibilities, looking into interdisciplinary communities and cultures that CALL 
can benefit from, these are some of the issues that our keynote speakers presented, 
explored and questioned. 

The Graham Davies keynote speaker, Mark Pegrum, presented the possibilities of 
mobile learning in its various forms and the implications of this kind of learning 
for language learning across the various cultures. This new learning methodology 
adopts 21st century skills, assists in the construction of new communities and 
allows the various cultures to develop within their own spectrum of abilities and 
possibilities. Understanding how mobile learning works around the globe allows 
us to also develop our own learning contexts and provide the optimal kinds of 
mobile learning that will be beneficial for our own learners in our specific academic 
environments. 

Panayiotis Zaphiris presented an empirical study of an online learning community 
that worked closely with the course design team under the participatory design 
process. This design process was implemented for a large online course of 
English speakers learning Greek and included four stages: establishing bridges 
with the proposed learner, identifying user needs and implementing suggestions, 
developing prototypes and finally providing feedback. The progress of the 
learners was constantly monitored and analysed throughout all stages. This 
participatory design methodology was based on the constructionism pedagogical 
theory. 

Leila Kajee analysed the influence of digital technology on our everyday lives. 
Societies in developed countries are exposed to a massive amount of information 
which is available in many forms: video, text, image and audio. Even more so 
in the children’s world, where, in their spare time they have the opportunity 
to retrieve information in the form of images, stories and so on. To prove her 
argument she presented three case studies which clearly indicate the construction 
of digital identity and how students engage in social networking practices. 
Leila Kajee used new literacy studies as a framework to provide a theory of 
literacy practices and the work of Hall among others to theorise identity. She also 
presented further implications of digital identity construction regarding teaching 
and learning. 
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Salomi Papadima-Sophocleous 


Recordings of these keynote addresses, as well as the full programme and session 
abstracts may be found at the conference website (http://eurocall2016.org/). 

We thank all of the participants of the EUROCALL 2016 conference and the 
presenters. 

All submissions for this volume have been rigorously reviewed: submissions 
received an average of two external reviews and were then subjected to further 
meta-reviewing. 

Producing this volume has been a joint effort of authors, reviewers, category co¬ 
chairs and the entire organising committee who contributed much time and effort. 
We woidd like to thank all contributors who reflect the enormous variety of topics 
which were addressed at this exciting event and the quality of the presentations. 
Without you this conference could not have taken place. We hope you will enjoy 
reading the volume as much as we have - the editors -, during its preparation. We 
hope that the essence of the EUROCALL2016 conference has been communicated 
to you through this volume. 


KaLtj Avdyvotari! (Enjoy reading these papers!) 

Salomi Papadima-Sophocleous 
Conference chair of EUROCALL2016 
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The impact of EFL teachers’ mediation in wiki- 
mediated collaborative writing activities 
on student-student collaboration 

Maha Alghasab 1 


Abstract. This paper focuses on how teachers mediate wiki collaborative writing 
activities, and the impact of their mediations on students’ collaboration. It is based 
on a study conducted with three English as a Foreign Language (EFL) teachers and 
their students (aged 17-18 years) at two government-funded girls’ high schools in 
Kuwait. The selected groups of students, supported by their class teachers, carried 
out wiki collaborative writing activities over a period of eight weeks. The writing 
activities were tracked from conception to completion, by closely analysing the 
wiki discussion and edits, in order to explore the process of interaction. This was 
triangulated with interview data with teachers and students to gain deeper insights. 
The results show that, despite the fact that all groups of learners and teachers 
received a similar type of training and worked on the same activity, there were 
some variations in the level of their collaboration. Teachers played an essential 
role in shaping the way that learners collaborated; i.e. some teachers’ behaviours 
promoted collaboration, while others hindered it. Although it can be acknowledged 
that the wiki is a powerful tool for student-centred collaborative writing, it can 
also be argued that the role of the teacher is indispensable, and the right kind of 
teacher intervention is critical to the success of collaborative writing, especially in 
educational contexts that are similar to Kuwaiti schools. Therefore, professional 
training is required in order to raise teachers’ awareness of effective pedagogy in 
supporting wiki-mediated collaborative writing activities. 

Keywords: wiki, collaborative writing, teacher mediation, student collaboration. 
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1. Introduction 

The use of wiki has captured the attention of researchers because of their potential 
for promoting collaborative writing, which is the process whereby two or more 
writers compose a text (Storch, 2005). Wikis have been proposed as tools to 
promote collaborative interaction, i.e. interaction that is rich in reciprocal feedback, 
consideration of another’s proposal, using a first person plural pronoun (we) 
throughout the activity (Li, 2013) and co-constructing the wiki text together by 
adding, expanding and correcting each other’s text (Bradley, Lindstrom, & Rystedt, 
2010). To date, studies conducted on student-student (S-S) interaction have reported 
mixed findings: some document a high level of collaboration (Li. 2013) whereas 
others observe instances of writing individually in a cooperative manner (Bradley 
et al., 2010), a reluctance to edit each other’s texts (Lund, 2008), and unequal 
participation (Li & Zhu, 2011). Therefore, computer-assisted language learning 
researchers have called for more teacher intervention in the wiki context (e.g. Lund 
& Smordal, 2006). However, previous wiki studies have not investigated this topic 
in depth. Given the prominent role that teachers play in promoting collaboration, as 
reported in other Face-To-Face (FTF) studies (e.g. Yoon & Kim, 2012), this study 
aims to qualitatively analyse the nature of teachers’ interventions and how this 
influences the students’ collaboration in the wiki context. The following research 
questions are proposed: 

• How do EFL teachers mediate students’ interaction in wiki-based 
collaborative writing activities? 

• What is the impact of their mediations on the level of students’ collaboration? 


2. Method 

2.1. Approach, context and participants 

A qualitative multiple case study design was adopted. One embedded case, a group 
of four learners working together, was selected for in-depth exploration from 
each teacher’s class. Based on students’ self-reported data of the behaviours in 
FTF collaborative activities, representative groups - in which there was a mix of 
students reporting both collaborative and non-collaborative orientations - were 
selected for in-depth exploration. The cases refer to the interactions of three small 
groups of learners with their teachers, with each interaction as a bounded system. 
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The study was conducted in two government-funded girls’ high schools in Kuwait, 
where English is taught as an obligatory subject five times a week. Using a 
convenient sampling method, three twelfth grade EFL teachers and their classes 
were recruited to participate in this study. All participants were non-native English 
speakers, their first language being Arabic. The students were all female, Kuwaiti 
learners of EFL, and their ages ranged from 17 to 18 years old. In the three groups, 
learners were asked to design a poster about Kuwait. Three PBwiki platforms were 
created for the purpose of the study. Each group was assigned a sub-topic, however, 
within each group there was no division of labour. The study was conducted in the 
second academic term, in February 2014, and lasted for 13 weeks. Table 1 presents 
the data collection timeline. 


Table 1. Data collection timeline 


Weeks 1 & 2 

Week 3 

Weeks 4 - 11 

Week 12 

Week 13 

Orientation/ 
background 
questionnaire 
and interviews. 
Teachers’ wiki 
training. 

Students’ 

training. 

Out of class 
wiki activity 
(designing 
a poster). 

Week 7 & 

11 teachers’ 
stimulated recall 
interview. 

Teachers’ 
post activity 
interview. 

Students’ 
post activity 
interview 
(individual 
interview). 


2.2. Data collection methods and analysis 

Data was collected through a systematic observation of the wiki discussion and the 
page history, teachers’ stimulated recall interviews, and semi-structured interviews 
with teachers and students. To characterise teachers’ interventional behaviour and 
students’ levels of collaboration, a framework was developed combining a priori 
(i.e. pre-established; used in previous research) and a posteriori (i.e. emerging 
from the data) categories. Teachers’ interventional behaviours were classified into 
three levels: organisational, socio-cognitive, and socio-affective (Mangenot & 
Nissen, 2006). The three levels of interaction were also used to refer broadly to 
how students interacted. Within each level, in the manner of Li (2013) and Arnold, 
Ducate, Lomicka, and Lord (2009), contributions to the discussion were further 
classified according to their functions (e.g. organising the work, seeking peer 
feedback, expressing emotions). Previous framework categories were considered in 
order to analyse editing behaviours (e.g. Mak & Coniam, 2008), including adding 
new ideas, expanding ideas, reorganising ideas, correcting, deleting, and synthesis 
of information. The unit of analysis was defined as either a post to the discussion 
forum or an edit action. Interview data was also coded thematically according to 
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their focus (organisational, socio-cognitive, and socio-affective levels). In order to 
enhance the reliability, the framework and its categories were explained to another 
researcher, and then the process of coding 15% randomly selected extracts was 
done independently by both researchers. Instances of agreement and disagreement 
were counted, and following Miles and Huberman’s (1994) inter-coder reliability 
formula, the inter-rater agreement reached 86.9%. The discrepancies were resolved 
by discussion. 


3. Findings and discussion 

Analysis of the teachers’ and students’ interactions in the wiki suggests that, despite 
the fact that all teachers and students received similar types of training and worked 
on a similar type of activity, there were variations in the level of collaboration 
across the three cases (see Figure 1), which upholds the findings of previous studies 
(e.g. Arnold et al.. 2009; Li & Zhu, 2011). The results also show that the way in 
which teachers intervened in the activity had an impact on the level of collaboration 
among students at organisational, socio-cognitive, and socio-affective levels. For 
example, Case 1 teacher employed a very structured approach: she divided the 
work among the students, gave direct task instructions, used an authoritative tone, 
immediately answered students’ language-related questions, and edited their wiki 
text. In direct contrast, Case 2 teacher only intervened in order to encourage students 
to participate, by suggesting ideas for the text, although she edited the students’ 
text. She appeared to assume that the students woidd autonomously engage in 
collaborative dialogue and the co-construction of the wiki text. On the other hand, 
Case 3 teacher intervened in order to encourage collaboration, by establishing a 
wiki culture of collaboration and positioning herself as a co-learner, in an effort 
to promote collaborative dialogue; she asked questions about students’ language 
use, modelled editing behaviours, and explicitly encouraged students towards such 
behaviour. 

An examination of student-student interaction indicates that the teachers’ 
interventional behaviours influenced how students interacted. Figure 1 shows the 
less collaborative group (Case 1), where the teacher structured the activity, students 
wrote individually, as instructed, ignored others’ suggestions, rejected others’ edits 
and depended on the teacher, with instances of seeking feedback occurring most 
frequently between the teacher and a student, rather than between students. In 
Case 2, where the teacher stepped back and intervened rarely, students failed to 
engage in a high level of collaboration, which supports the findings of previous 
research (e.g. Lund & Smordal, 2006). Although the students’ writing behaviours 
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involved adding to and expanding on each other’s ideas, they rarely engaged with 
each other in a collaborative dialogue by seeking and providing feedback on the 
text. In Case 3, the teacher’s mediation of the students’ interaction caused them to 
gradually engage in collaboration. High levels of collaborative behaviours emerged, 
including writing collaboratively by adding to, expanding on and correcting each 
other’s existing texts, and engaging in a collaborative dialogue by questioning, 
elaborating on and suggesting alternatives to each other’s language use. These 
collaborative behaviours have also been reported in other studies (Li, 2013), in 
which learners were novices individually and experts collectively. 

Figure 1. Teachers’ intervention and learners’ interaction 




Case 1 

Case 2 

Case 3 


Ms. Susan 

Ms. Danah 

Ms. Wesam 


. 

Divided the work 

■ Stepped back 

■ Promoted a wiki culture of 


■ 

Direct edits 

■ Direct edits 

collaboration 

O 

■ 

Immediate responses to 

■ Suggested ideas 

■ Modelled editing 

if 

S .£ 


students" questions 

■ Used an authoritative 

behaviours 

■ 

Used an authoritative 

tone 

■ Positioned herself as a co- 


tone 


learner 

i- .a 




■ Used a friendly tone 


. 

Writing individually in 

■ Adding and expandins 

■ Writing collaboratively 



parallel 

on each other's ideas 

(adding, expanding on and 


■ 

Dependence on the 

■ Dependence on the 

editing each other's text) 



teacher 

teacher 

■ Instances of collaborative 


■ 

Occurrence of non- 

■ Absence of 

dialogue and collective 



co llaboralive 

collaborative dialogue 

scaffolding 

o 


behaviours (refusing 

■ Suggestion are 

■ Predominant use of the 



others’ 

incorporated into the 

first person plural pronoun 

s 


edits/ suggestions are 

text 




never incorporated into 

■ Frequent use of first 




the text). 

and second person 




Absence of 
collaborative dialogue 

pronouns 




Frequent use of first 
and second person 





pronouns 



Non-collaborative 



interaction 




Collaborative interaction 


4. Conclusion 

Although wiki is a powerful tool for student-centred collaborative writing, the role 
of the teacher is indispensable, and the appropriate kind of teacher intervention 
is critical to the success of collaborative writing. This study has showcased how 
certain teachers’ behaviours directly impact how students collaborate. Thus, 
professional training is required in order to raise teachers’ awareness of effective 
pedagogy in supporting wiki-mediated, student collaborative writing. 
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Towards the development of a comprehensive 
pedagogical framework for pronunciation 
training based on adapted automatic 
speech recognition systems 

Saandia Ali 1 



Abstract. This paper reports on the early stages of a locally funded research and 
development project taking place at Rennes 2 university. It aims at developing a 
comprehensive pedagogical framework for pronunciation training for adult learners 
of English. This framework will combine a direct approach to pronunciation training 
(face-to-face teaching) with online instruction using and adapting existing Automatic 
Speech Recognition systems (ASR). The sample of learners chosen for the study are 
university students majoring in Arts, Literature or Communication at graduate and 
undergraduate level. These students might show an advanced mastery of grammar 
and syntax, but their spoken English remains heavily accented and may hinder 
effective communication. A considerable body of research has already investigated 
the efficacy of ASR systems for pronunciation training. This paper takes stock of 
how Computer Assisted Pronunciation Training (CAPT) software has been used 
and developed so far and looks at further potential improvements to address bad 
pronunciation habits among French learners of English. 

Keywords: computer assisted pronunciation training, automatic speech recognition, 
CALL system design, ESL. 


1. introduction 

Pronunciation is an area of teaching which is often neglected, probably because 
teachers lack time and often resources to enable them to tackle phonetic and 
phonological competences. In most French universities, classes are overcrowded (up 
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to 40 students per group) and the emphasis is placed on fluency and communication 
skills rather than phonetic accuracy. In addition to this observation, most teachers 
do not feel confident with teaching pronunciation as they often haven’t received 
any training themselves. 

Under these circumstances, students experience performance anxiety, and they only 
have a limited amount of time for teacher-student interaction and individualized 
feedback. As mentioned by Eskenazi (1999), “[l]anguage learning appears [to 
be] most efficient when the teacher constantly monitors progress to guide [...] 
remediation or advancement” (p. 450). 

CAPT programs (Abuseileek, 2007) could help realise these goals by offering 
individual practice and feedback in a safe environment. Recent ASR based CAPT 
programs include Subarashii (Entropic HTK recognizer), VILTS (SRI recognizer), 
FLUENCY (Carnegie Mellon University SPHINX recognizer), Naturally Speaking 
(Dragon Systems), and FluSpeak (IBM Via Voice recognizer). 

We intend to build on these existing programs and on previous research to develop 
a set of tools to address bad pronunciation habits among French learners of 
English. In an attempt to do so, the rest of this paper will elaborate on the following 
questions: 

• How have ASR systems been used to teach pronunciation? 

• What improvements are still needed to develop an ideal pronunciation 
training framework for French learners of English? 


2. Using ASR systems for pronunciation training: 

an overview of existing tools and previous research 

2.1. Smartphone commercial apps 

The simple act of googling ‘pronunciation training apps’ shows the considerable 
number of tools and software available to help people acquire good pronunciation. 
Two main types of pronunciation training apps can be found: those that target 
a wide variety of users ranging from students to other users, including tourists 
or occasional users, and those that were developed by teachers or researchers 
specialising in the domain of language learning and teaching. The first type of apps 
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(see for example pronunciation checker, English pronunciation checker 2 3 or Vowel 
Viz 4 for iPhones) are used to check or verify the accuracy of one’s pronunciation 
in a number of contexts. Pronunciation checker is a multilingual app based on 
databases of up to 1000 words for each targeted language and enables the user to 
listen to the production of a word, practise saying it via a recording device and 
then obtain an evaluation of the resulting production as a ‘score’. There are two 
proficiency levels: easy and hard. This type of app usually lacks depth and doesn’t 
include any linguistic or didactic information as an input or as a diagnosis, which 
is often limited to a numerical score. 

The second kind of app is based on more in-depth linguistic and sometimes 
pedagogical content (see for example Sounds pronunciation apps 5 by Macmillan, 
English pronunciation 6 by Kepham or Speech Ace 7 ). Most of these apps focus on 
pronunciation training at segment level and include pre-training tasks and content 
which revolve around interactive phonemic charts and illustrated descriptions of 
the articulatory features of the sounds of English. Recording facilities are also 
included along with diagnoses of learners’ productions that can be compared with 
targeted productions in the chosen model (often US or UK English). 

2.2. Experimental research aiming at CAPT software development 

Numerous studies have tackled the question of ASR efficacy for CAPT (see e.g. 
Hinks, 2001). In this section, we present a brief overview of three representative 
studies (i.e. Elimat & Abuseileek, 2014; Escudero & Tejedor-Garc, 2015; Kim, 
2006) that led to the development and testing of experimental ASR-based software 
for pronunciation training in English. They provide three different examples of 
how ASR systems and pronunciation teaching strategies can be tested and reveal 
the remaining challenges of current ASR technology. 

Escudero and Tejedor-Garc (2015) introduce the architecture and interface of a 
serious game intended for pronunciation training and assessment of Spanish 
students of English as a second language. Android ASR and text to speech tools 
make it possible to discern three different pronunciation proficiency levels, ranging 
from basic to native. The authors use minimal pairs to promote learners’ awareness 


2. https://play.google.com/store/apps/details?id=com.app.pronunciation_checker 

3. https://play.google.com/store/apps/details?id=com.eapp.pc 

4. https://itunes.apple.com/us/app/vowelviz/id740035896?mt=8 

5. https://play.google.com/store/apps/details?id=com.macmillan.app.soundsfree 

6. https://play.google.com/store/apps/details?id=com.study.english.pronunciation 

7. http://www.speechace.com/ 
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of the potential misunderstandings and wrong meanings that can result from too 
approximate productions of phonemes. 

Elimat and Abuseileek (2014) use the ‘Tell me more performance’ program to test 
the efficacy of ASR systems as well as various teaching techniques (i.e. individual 
work, pair work, group work) to train third grade learners of English. The best 
results were obtained with the group of students who worked individually with the 
ASR system. 

The study of Kim (2006) resulted in the creation of Fluspeak, which is an ASR 
based pedagogical software used to teach US English pronunciation. It was tested 
with 36 university students through a hybrid teaching approach mixing Face to face 
teaching with individual work with the software. The study included a comparison 
between human scoring and automatic scoring with Fluspeak. Although Fluspeak 
gave good results with beginners focussing on phoneme production, it gave poor 
results overall for advanced learners trying to gain fluency. 

On the whole and to our knowledge, most CAPT softwares show promising 
results and very positive impacts on the pronunciation of segmental sounds among 
various types of learners. Prosodic features and fluency generally speaking are 
areas of pronunciation training that still seem to require further research and 
development. 

2.3. Towards enriching an ASR based pronunciation training 
system with linguistic and pedagogical content 


Drawing conclusions from previous research and from an evaluation of commonly 
used CAPT software, this section provides an outline of the intended enrichment and 
development steps that need to be taken to develop a comprehensive pedagogical 
framework for pronunciation training. Three main steps were identified: 


• selecting an open source ASR system to be adapted and further enriched 
to suit our purposes; 

• enriching input data with prosodic information: selecting prosodically 
labelled corpora (LI English, LI French, L2 French); 
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Several open source speech recognition toolkits are available for research and 
development (see (Gaida et ah, 2014; Povey et ah, 2011). Gaida et ah (2014), for 
instance, compare the most commonly used open source softwares and show that 
the Kaldi toolkit is the most efficient and easier to adapt than the CMU sphinx 
toolkit for instance. 

The common approach to recognize speech is to take a waveform, split it in 
utterances by silences and then try to recognize what is being said in each utterance. 
In order to do so, all possible combinations of words need to be tested and matched 
with the audio so as to select the best matching combination. Three models are 
used to complete the matching process: the acoustic model (acoustic properties for 
each phoneme of the target language), the phonetic model or phonetic dictionary 
(with the mapping from word to phone) and a language model (defining which 
word can follow another and restrict possible combinations). 

Starting from the Kaldi toolkit, prosodic information can be added at the level of 
the acoustic model, which is usually based on large corpora annotated at segment 
level. We propose to use our own corpus developed in previous studies (see Ali. 
2010; Ali & Hirst, 2009) to train Kaldi with prosodically annotated data in English. 
The chosen intonation model for this corpus is defined in Hirst and DiCristo 
(1998) and based on automatic modeling of rhythm and intonation via the Momel- 
Intsint algorithm (see Hirst & Espesser, 1993). Learner corpora (Diderot Longdale 
corpus and CIL corpus) will also be used to train the ASR system to recognize the 
productions of French learners of English at various proficiency levels (beginner, 
intermediate, advanced). 

Once the recognition process has successfully taken place, pedagogical content 
will be added. Three kinds of tasks will be introduced: 

• reading tasks based on isolated words (to assess phoneme production in 
monosyllabic words and word stress in polysyllabic words); 

• reading tasks based on full utterances (to assess rhythm and intonation); 

• conversation and guided interaction with virtual agents (to develop 
interaction skills, fluency and discourse level prosodic features). 

Explicit feedback and diagnosis will be provided for each type of task using 
recording facilities along with Praat and Momel-Intsint representations to visualize 
productions and compare them to the target models. 
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3. Conclusion 

Related studies such as Elimat and Abuseileek (2014) have shown that the ideal ASR 
software for CAPT should include at least five phases: ASR, automatic scoring on 
the basis of the comparison between a student’s utterance and a native’s utterance, 
error detection and error diagnosis. Starting from these essential characteristics and 
an evaluation of existing software, further improvements and preliminary steps were 
proposed in this paper in an attempt to develop a pronunciation training framework 
for French learners of English. The first steps mainly consist in enriching an existing 
open source ASR system with prosodic information to tackle the limitations of ASR 
tools when used to provide feedback at sentence and discourse level. This could 
be achieved by training ASR systems with both native and non-native speakers’ 
prosodically labelled corpora. Further steps include the provision for enriched 
pedagogical content once the recognition process has successfully taken place. 
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study in EFL teacher development 

Christopher Allen 1 and Jan Berggren 2 



Abstract. This project introduces the concept of digital literacy at a practical 
level to a group of EFL teachers within the context of a single work place; a 
technologically well-resourced upper secondary school in Sweden. English 
teachers were provided with a theoretical and practical overview of the digital 
literacy concept as described by Dudeney, Hockly, and Pegrum (2013) before 
being given the task of each teaching a lesson. The teachers’ reflective experiences 
of incorporating digital literacy into advanced level English teaching were then 
evaluated through a focus group interview. The results obtained show the efficacy 
of incorporating small scale exploratory practice research projects alongside busy 
teaching schedules and administrative demands as well as developing teachers’ 
perspectives on Information and Communications Technology (ICT) in the English 
as a Foreign Language (EFL) classroom. In addition, the project has promoted 
synergies and collaboration among a school staff engaged in the long-term goal of 
continued professional development. 

Keywords: digital literacy, exploratory practice, in-service training. 


1. introduction 

1.1. In-service training and ICT 

In the era of digitalization, modem language teacher training faces significant 
challenges in responding to the pace of technological and educational change 
and incorporating these developments into a coherent blueprint for classroom 
practice. Digital literacy, as described by Dudeney et al. (2013), offers one possible 
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framework to facilitate the integration of ICT and a language subject such as 
English. This publication provided EFL teachers with a comprehensive framework 
for the incorporation of Web 2.0 digital technology into their daily classroom 
routines. 

This paper describes a small-scale project to introduce digital literacy to a group of 
EFL teachers. The teachers were first introduced to the digital literacy framework 
before being asked to select one or more digital learning activities which they 
should teach and then evaluate. The evaluation of their experiences was carried out 
in the form of a video recorded collegial focus group interview. 

1.2. Perspectives on teaching training 

Beginning in the 1980s, perspectives on professional teacher development 
have increasingly focused on teachers as reflective practitioners (Schon, 1983). 
Inspired by reflective practitioner perspectives, subsequent authors have suggested 
a formalization of the professional development process in the form of action 
research; small-scale research projects carried out by teachers in their classroom 
contexts in response to a perceived problem (Kemmis & McTaggart, 1982). The 
action research tradition has, however, tended to be individualistic, with a focus on 
individual teachers focusing on problems in isolation. The work of Burns (2001) 
puts the spotlight instead on collaborative action research initiatives with the 
potential for staff to learn from one another in exploiting the potential synergies of 
collegial efforts. 

More recently within language education. Exploratory Practice (EP) was put 
forward as a possible method for teachers investigating solutions to educational 
problems (Allwright, 1993; Allwright & Bailey, 1991; Allwright & Lenzuen, 
1997). This alternative approach is a recognition of the significant demands made 
by reflective and action research projects on the working lives of busy teachers. 
A central tenet of the EP framework is bringing teachers together and promoting 
collegiality as an activity “best served if all involved are manifestly working for 
each other’s development as well as their own” (Allwright, 2003, p. 129 quoted in 
Hanks, 2015, p. 614). 

1.3. Digital literacy 

In a series of recent publications (Hockly, 2012; Dudeney et al., 2013), digital 
literacy has been put forward as a means of seamlessly integrating technology into 
the foreign language classroom. 
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Table 1. Digital literacy focus areas (adapted from Dudeney et al.. 2013, p. 6) 


Language focus 

Information focus 

Connections 

(re-)design 

print literacy 




texting literacy 

search literacy 



hypertext literacy 

tagging literacy 

personal literacy 


multimedia literacy 

information literacy 

network literacy 


gaming literacy 

filtering literacy 

participatory literacy 


mobile literacy 


intercultural literacy 


code literacy 



remix literacy 


The outline has been favourably received by the international EFL community. 
However, White (2015) has criticized the framework for a perceived imbalance in 
its focus on the receptive rather than productive skills. 


2. The study 

Eight English teachers with between two and 21 years’ teaching experience at a 
large upper secondary school in southern Sweden took part in the study. The design 
of the project encompassed three practical stages: 

• two initial seminars/workshops offering teachers a theoretical and practical 
overview of the concept of digital literacy as well as outlining the teaching 
task; 

• teaching of a digital literacy-based lesson using one of the 50 activities 
provided in the Digital Literacies resource book; 

• a concluding focus group interview in which the teachers offered their 
experiences of integrating digital literacy into advanced level English 
teaching. 

Each teacher taught at least one lesson based on lesson plans provided by Dudeney 
et al. (2013). After teaching their lessons the teachers were gathered in a focus 
group interview where the teachers provided their reflective experiences of (1) 
incorporating digital literacy into advanced level English teaching at the school, 
(2) the extent to which digital resources can replace or augment ‘traditional’ course 
books and finally (3) the efficacy of lesson evaluation as a form of exploratory 
practice. The focus interview was recorded and transcribed for further analysis. 
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Table 2. Outline of teacher activities and digital literacy areas in the focus group 


Teacher 

Activity from 
resource book 

Aim 

Digital 

literacy 

EL 

No. 12: Sales 
Techniques 

produce an advertisement 
in the form of a vodcast 

multimedia 

SJ 

No. 27: Tree octopus 

raise awareness of the importance 
of evaluating information on websites, 
by visiting a number of spoof websites 

information 

JK 

No.3: Faking it 

raise awareness of social 
networking profiles, online identity 
and identity management 

personal, 

network 

MO 

No.17: Choose your 
own adventure 

raise awareness of and 
implement basic game design 

gaming 

No. 18: History hunt 

create a local history quiz in the 
form of a multimedia mobile app 

multimedia, 

gaming 

DS 

No. 4: Extreme 
Weather 

raise awareness of how to 
convey a message via different 
genres of online text 

print, 

information 

No. 6: 

Codeswitching 

raise awareness of codeswitching 

texting, print 

AS 

No. 12: Sales 
Techniques 

produce an advertisement 
in the form of a vodcast 

multimedia 

No. 44: Vox Pop 

make a vodcast about culture 

intercultural, 

multimedia 

MSB 

No. 6: 

Codeswitching 

raise awareness of codeswitching 

texting, print 

No. 12: Sales 
Techniques 

produce an advertisement 
in the form of a vodcast 

multimedia 


3. Results and discussion 

The responses to the interview questions are presented below in accordance with 
the three focus areas outlined above. 

3.1. The teachers’ reflective experiences of incorporating 

digital literacy into advanced level English teaching 

The teachers all agreed that the integration of digital literacy into advanced level 
English teaching greatly stimulated interest in learning English, especially among 
pupils who had opted for more practical, vocationally-orientated subj ect combination 
profiles. Teachers responsible for more academically-orientated subjects in the 
Technology Program were also positive, claiming that the incorporation of digital 
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literacy into their EFL classrooms had inspired their pupils. Staff also reported that 
the opportunity to work with intercultural literacy was most appreciated by the 
pupils involved. Pupils were offered the opportunity to explore communication in 
a cultural content involving people coming from other cultures, through Skype or 
recording a video presenting their hometown. 

3.2. The extent to which digital resources can replace 
or augment ‘traditional’ coursebooks 

Teachers highlighted the added multimedia dimension to their teaching which 
introduced a new level of creativity into their classroom practice, having previously 
worked with more traditional language teaching activities such as gap-filling, 
vocabulary lists and coursebook exercises. A number of teachers expressed that 
their pupils performed better when digital literacies integrated into their English 
teaching, since it was easier to adapt their teaching to the needs of individual 
pupils. It was also noted that the approach lent itself readily to the incorporation of 
authentic material in their classrooms, encouraging pupils to think critically about 
the reliability of digital information sources. 

Another positive feature was the opportunity to analyse texts from different 
digital contexts or genres, as well as adapting texts from one digital context to 
another, such as converting a blog entry into a tweet, Facebook post, etc. These 
comparisons led to a heightened awareness among pupils of the differences 
between informal and Standard English varieties. Other pupil discussions 
revolved around open educational resources and Creative Commons digital 
copyright issues. 

3.3. The efficacy of lesson evaluation as a form 
of exploratory practice (collegial learning) 

Participating in the Digital Literacy project, teachers had an opportunity to learn 
and reflect upon concepts of professional relevance of digital literacies. Many 
teachers found that they had developed their repertoire of teaching activities in 
which digital literacies are integrated in advanced English language learning. 
Above all, this group of teachers now has access to concepts of professional 
relevance and an overview of digital literacies, which can be made of use in 
future in-service training, or collegial learning. Developing a professional 
language and an ability to teach digital literacies constitutes an updated 
professional identity for this group of teachers and is also a guarantee in itself 
of sustainable in-service training. 
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4. Conclusion 

A major challenge for researchers is to bring positive change in the classroom 
without impinging too heavily on other professional priorities such as lesson 
planning, grading and assessment and pastoral considerations. The results suggest 
a way forward in promoting the sustainable incorporation of ICT into mainstream 
English language teaching and encouraging professional development on a 
collegial level. Future research will be directed towards building upon this collegial 
knowledge of digital literacy in developing greater consistency and objectivity in 
the assessment of digital projects. 
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Abstract. The relentlessly accelerating global educational demands for teaching 
English as a Second or Foreign Language (ESL/EFL) in multiple, diverse, and often 
remote geographic locations constitute new challenges for academic institutions, 
teacher training and preparation programs, and teachers themselves. This study 
describes a novel approach where five elementary school preservice teachers 
teaching ESL/EFL borrowed an iPad mini from their teacher training institution 
customized with specific apps to record a series of five teaching sequences during 
their teaching practice placement in elementary schools in Tanzania and Kenya. All 
recorded sessions were uploaded to a Moodle Virtual Learning Environment (VLE) 
site specially constructed for the purpose of the teaching practice course. Results 
indicate that, apart from their experienced instructors’ feedback on their teaching 
practice, the recorded sessions formed constructive tools for self-reflection, self- 
evaluation and the pursuit of possible paths for improvement. 

Keywords: iPads, ESL, EFL, pre-service teachers, teaching practice, self-evaluation. 


1. Introduction 

Mobile devices, which fuse technology, culture, communication, learning and 
gaming, challenge some of the most salient social and cultural boundaries while at 
the same time inviting a discussion into their role in molding cultural expectations 
for teaching, learning, communication, and socialization. In ESL/EFL pedagogy 
and teacher preparation, scholarly research on mobile-based learning has delved 
into the pedagogical and learning implications of mobile devices (Goodwin-Jones, 
2011; Hockly & Dudeney, 2014; Kinash, Brand, & Mathew, 2012; Kukulska- 
Hulme, 2009). Multiple studies have been undertaken and scholarly discussions 
have been built on the premise that, if mobile devices and software are exploited 
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effectively in language learning contexts, they can expand the classroom ecology 
and galvanize students’ learning (Vavoula, Pachler, & Kukulska-Hulme, 2010; 
Kinash et al., 2012). Beyond the multi-purpose nature, mobility, adaptability, and 
interactivity of mobile devices, scholars have also looked into the impact that 
mobile devices can have on language learning (Kukulska-Hulme, 2009). Kukulska- 
Hulme (2009) makes a call to educators constructing mobile learning activities “to 
enrich these types of learning and enrich them with new possibilities” (p. 160). It 
is not only learning but also teaching in the form of teachers’ self-evaluation with 
recordings of their classroom performance that could be enhanced through the use 
of mobile devices. Previous studies, such as Bolona Lopez, Ortiz, and Allen (2015) 
have demonstrated that smartphones could form effective tools for assessing EFL 
student teachers’ teaching practices in Ecuador. However, limited attention has 
been paid to the use of iPads as tools to record and facilitate self-evaluation among 
pre-service teachers on teaching practice in geographically remote locations. 


2. Method 

This study aimed to investigate the role of iPads as tools to evaluate pre-service 
teachers’ teaching practice and their perception on the integration of iPads in the self¬ 
confrontation of the teachers with video recordings of their perfonnance. In adopting 
a qualitative approach, this study offered preservice teachers a level of autonomy in 
selecting specific parts from their practical teaching experience and the opportunity 
to record sessions in specific pupil age range and cultural/institutional settings. It also 
gave ‘a voice’ to preservice teachers to share their experiences throughout this process 
(Levy, 2015). The study was conducted during the fall of 2015. Five female primary 
preservice teachers enrolled in a teaching practice course at a Swedish academic 
institution were provided with an iPad mini for their five-week practicum. The 
preservice course aimed to offer preservice teachers practical teaching opportunities 
to teach English to primary school children in diverse locations, such as Kenya and 
Tanzania. All preservice teachers had previously completed their practical teaching 
placement in Swedish schools. Prior to their departure, they attended an orientation 
session with two experienced teacher trainers, the first and third authors of this paper. 
Both instructors specialize in computer-assisted language learning, information 
communication and technology, and teacher training. During the orientation session, 
preservice teachers were introduced to the pedagogical expectations for the practice 
and received tech training on relevant applications and resources to facilitate 
communication with the instructors and video uploading on their iPads, such as 
Skype and Adobe Connect and Moodle. Figure 1 below provides a screenshot of the 
iPad minis provided to preservice teachers. 
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Figure 1. Screenshot of the iPad minis prior to departure 



Students were invited to upload five shorter lesson sequence recordings on 
their academic institution’s Moodle VLE site: (i) a brief video confirming their 
arrival in the host country and school site; (ii) the introduction of the subject of 
instruction and delivery of instructions to students; (iii) the delivery of a lesson on 
vocabulary, grammar, and/or pronunciation; (iv) the monitoring of group work and 
use of contingent feedback; and (v) the conclusion of the lesson and preparation 
for the next activities. These five recording sequences could be selected by the 
preservice teacher from any lesson during the practicum period; they did not have 
to be from the same lesson. The intention from the instructors’ side was to provide 
feedback formatively following the upload of each lesson component throughout 
the practicum using the tools installed on the iPads. Following their return to 
Sweden, preservice teachers received summative feedback from their instructor 
and completed a written questionnaire which attempted to evaluate the learning 
experience through a mixture of open and fixed response questions. 


3. Results and discussion 

Each preservice teacher uploaded her five recordings on the Moodle VLE site and 
four of them responded to the written questionnaire. Upon their return to Sweden, 
they met with their instructors and received constructive feedback on their teaching 
techniques, student group work, delivery of lesson plans, classroom management, 
and other classroom issues that emerged during the recordings. Unfortunately, 
technological contractions and challenges, such as limited or complete lack of 
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Wi-Fi access, inhibited the provision of feedback while students were teaching 
in the particular teaching context. All four preservice teachers addressed the lack 
of or limited Wi-Fi access in their questionnaires and considered it as a hindering 
mechanism in uploading their videos and receiving feedback. As Selma, a twenty- 
four year-old preservice teacher noted in her written response, “we couldn’t upload 
our videos when we where [sic] away because of the internet connection”. 

Despite these technological challenges, all four preservice teachers perceived the 
use of iPads as effective tools for self-confrontation with recordings of their teaching 
performances. As they noted on their written questionnaires, viewing themselves 
in action while they were teaching and observing their teaching techniques, 
classroom dynamics, group work, and the delivery of their lesson plans played a 
central role in reflecting on their teaching practice and identifying possible ways to 
improve. In addition to their experienced instructors’ feedback, preservice teachers 
critically reflected on their own teaching and pursued possible ways to improve. 
The use of these cultural artifacts or recordings enacted affordances for self¬ 
reflection and self-evaluation, while at the same time heightening awareness of the 
multiple classroom dynamics, management, and other pedagogical, instructional, 
and other learning constructs. For instance, as Felicia, another twenty-four year- 
old preservice teacher candidly admitted: “since you are able to see the recorded 
video after the lesson you see many things that you can improve, for example 
how you focus which pupils who gets your attention the most, or how you try to 
explain things”. What they also particularly enjoyed was the flexibility and choice 
in selecting the recorded sessions that they felt more comfortable sharing with their 
instructors, which eliminated preservice teachers’ level of anxiety. Selma summed 
it up best: “1 think everybody should record themselves while teaching it feels 
wierd [sic] the first time you have to watch yourself but learned a lot from it! And 
now I am not nervous to have someone in the classroom when I teach and I am 
better at taldng feedback”. 


4. Conclusion 

The findings of this study demonstrate some of the possible implications that 
recorded sessions on iPads could have on preservice school teachers’ initial 
endeavors as they break into the complex arena of teaching. Teaching constitutes 
a complex, demanding, and at the same time rewarding profession. However, 
preservice teachers need not only to receive constructive feedback from experienced 
teacher trainers but also to be presented with their own teaching performance as 
a means to reflect and evaluate their own teaching practice and identify possible 
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ways to improve. The use of iPads to record their initial teaching experiences 
can contribute to this process by enacting affordances for preservice students to 
observe their teaching in action and critically evaluate their own teaching practice. 
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in foreign language education 

Antonie Aim 1 



Abstract. This paper discusses the animated web series Lifeswap as an example for 
‘amateur online interculturism’ and investigates its potential for intercultural language 
education. Drawing on Dervin’s (2015) discussion on the ‘amateur interculturist’, I 
suggest that online publications of personal encounters of intercultural interaction can 
be used to foster critical reflection in intercultural language education. To illustrate 
this idea, I first introduce the concept of ‘amateur online interculturism’ and the 
approach of the makers of the Lifeswap series. I then focus on one episode to provide 
an example of the series and to show how humour and cultural stereotypes can be used 
constructively to explore tensions in intercultural interactions. The online comments I 
present in the last section highlight the harmonising effect of humour but indicate that 
pedagogical intervention is needed to problematise intercultural issues. 

Keywords: interculturalism, amateur interculturist, lifeswap, humour. 


1. Introduction 

Growing mobility and increased opportunities to publish and share personal 
impressions of encounters with people of other cultures have resulted in new 
resources for intercultural language education. The travel blog matador, for 
example, publishes regular posts of travellers, such as “Are Germans rude? 
Killing the stereotypes after living in Berlin”. Shared on social networks, these 
personal accounts are exposed to a wide audience, natives and sojourners alike, 
often leading to animated discussions on incidents described by the authors. 

1 will refer to these accounts of personal intercultural experiences, which are shared 
with an online audience and discussed amongst this audience as ‘amateur online 
interculturism’. 1 have borrowed the term from Dervin (2015), who associates 


1. University of Otago, Dunedin, New Zealand; antonie.alm@otago.ac.nz 

How to cite this article: Aim, A. (2016). Amateur online interculturalism in foreign language education. In S. Papadima- 
Sophocleous, L. Bradley, & S. Thouesny (Eds), CALL communities and culture - short papers from EUROCALL 2016 
(pp. 25-31). Research-publishing.net. https://doi.org/10.14705/ipnet.2016.eurocall2016.533 


© 2016 Antonie Aim (CC BY-NC-ND 4.0) 


25 




Antonie Aim 


positive qualities with ‘amateur’, as it derives from old French, the ‘lover of’. 
The authors and participants of ‘amateur’ online publications are guided by their 
personal and often uncritical views, yet they manifest a passion for the encountered 
cultures and a fascination for observed personal transformations. At the same time, 
these views are presented as perspectives rather than truths and invite comments for 
discussion. These testimonies (online publications and the ensuing conversations) 
lend themselves to analysis in intercultural education as they provide students with 
a personal point of reference (descriptions reflecting their own experiences), which 
can then be taken to a more critical and reflective level. 

This paper discusses the animated web series Lifeswap as an example of ‘amateur 
online interculturism’ and investigates its potential for intercultural language 
education. The term ‘amateur interculturalist’ has been coined by Dervin (2015) 
in reference to Said’s (1996) concept of the ‘intellectual amateur’. It describes 
the intercultural practitioner or researcher who is not conditioned by essentialist 
intercultural theories and instead questions container models of culture. The 
‘amateur interculturist’ (unlike the ‘professional interculturist’) is aware that people 
are not defined by their culture and recognises that each individual has multiple 
identities, which are not only context-dependent but also change over time. The 
object of intercultural study is therefore never only the ‘other’ but also the ‘self’ 
and the dialogue between the two in a specific context. 

Increasing global mobility and the ability to communicate and publish online has 
produced another type of amateur interculturist. Equally guided by their love and 
passion for intercultural encounters, amateur online interculturists share personal 
experiences and observations with an online audience. It has been noted that the 
contact with people of different cultural backgrounds, especially in computer- 
mediated communication, does not necessarily lead to increased intercultural 
awareness and that on the contrary “can contribute to creating more stereotypes, 
negative and positive representations about the self and the other” (Dervin, 2014, 
p. 192). Yet it could also be argued that the open forum in which these reports 
are published can potentially create a space for critical reflection. Furthermore, 
the interactions on intercultural issues can be valuable material for intercultural 
language education. 


2. Method 

With the aim of establishing an example of ‘amateur online interculturalism’ and 
of exploring its suitability for intercultural language education, the following 
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materials have been analysed: (1) documents produced by the authors of Lifeswap 
about their web series (interviews, funding application, Lifeswap blog http://www. 
lifeswap.net/), (2) the second episode, The Tea Towel Stinks, and (3) comments 
from viewers on episode two from the Lifeswap blog, a Vimeo site as well as from 
university language students on their learner blogs. 


3. Discussion 

3.1. The Lifeswap interculturists 

The producers of the series are not trained interculturists, rather they are participants 
and observers of intercultural encounters. The fictional characters of Lifeswap, 
Jorg from Germany and Duncan from New Zealand, represent, according to the 
scriptwriter William Connor, an “alter-ego duo through which we could ‘earth’ the 
various frustrations, hilarities and intriguing cultural differences we had discovered 
repeating themselves whenever Steffen [Kreft] and I visited each other’s countries” 
(Ritchie, 2014, p. 19). Both Connor and Kreft had compiled ‘secret mental lists’ of 
intercultural incidents over the years. The use of humour can provide a safe place 
for the examination of potentially uncomfortable issues (MacIntyre, 2014) and the 
creation of a humorous context for their experiences allowed them to deal with these 
incidents in a playful manner. Each episode captures a particular ‘rich point’ (Agar, 
1994), to which, as Kreft put it “as many specific situations, archetypes and phrases” 
were added to achieve “maximum funniness and recognisable idiosyncratic scenarios 
within a tight and manageable animation” (Ritchie, 2014, p. 19). 

Humorous and exaggerated cultural stereotypes can be used constructively to 
identify and overcome tensions in intercultural interactions (MacIntyre, 2014). It is 
particularly powerful if the participants are able to laugh about themselves, and as 
it is the case in Lifeswap, if both cultures are targeted. 

The episodes of the on-going series are framed by a Skype conversation between 
Duncan, who is described by the authors as “a familiar Kiwi OE candidate in 
his mid twenties”, and Jorg, “a typically polite, well-equipped German traveller, 
who is passionate about ‘za nature’” (Funding application, n.p.). Conner gives 
the characters their stereotypical language, and Kreft’s illustrations support the 
humorous intent of the dialogues. Jorg and Duncan have swapped lives, or at 
least their flats, for a year and in their stereotyped appearance (clothing, accents) 
they seem oddly out of place in their equally stylised new environment: Jorg 
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skypes from his bedroom, a room of a typical New Zealand 1920s bungalow with 
wooden doors and window frames, whereas Duncan sits in a very plain and tidy 
German living room. 

3.2. The genesis of episode two 

The idea for the episode is born out of an anecdote, a personal encounter with 
‘German directness’ (see Figure 1). The request for a new tea towel, because the 
old one stinks, has an unexpected effect on the Kiwi. “I was taken aback... but 1 
was also taken aback by how taken aback I was”. His emotional reaction made 
him reflect on his cultural conditioning, and how indirectness might appear to 
somebody from a different cultural background. 

Figure 1. Blog post on second episode 2 


How a smelly tea-towel inspired episode two... 

Well, it all started when Steffen's 
mother, Margot, came to visit us 
in New Zealand. One afternoon 
we were enjoying a cross cultural 
dish-washing session, when all of 
a sudden, Margot turned to me 
and said: 

"William, the tea towel stinks. 

You need a new one." 

I was taken aback, not only by 
this wonderful example of 
German directness - the 
streamlined, teutonic "subject, 
verb, object" model of sentence construction - but I was also taken aback by how taken 
aback I was. 

The fact is, life in New Zealand is generally pretty simple and easy; that is, until a problem 
needs confronting. At which point we Kiwis engage in a weirdly elaborate series of rituals 
including red-faced silences, eye-averting and all manner of verbal apologies, softeners 
and excuses. One feels compelled to perform a kind of musical act to avoid explaining what 
the problem is; it commonly involves a small jerky dance of shrugs, hand-wringing and 
facial contortions and a sing song of polite words. 

So, in episode two of Lifeswap, Duncan teaches Joerg a five step method he has devised of 
confronting a New Zealander about a problem so as to cause only minimal offense. Watch 
this space! 



2. http://www.lifeswap.net/2013/10/how-smelly-tea-towel-inspired-episode.html 
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3.3. Episode 2 

In the episode, Jorg commits the same faux pas as the real life Margot, telling his 
Kiwi flatmate Ange that he needs a fresh tea towel. He quickly realises his mistake 
and brings it up at their next Skype conversation. Duncan gives Jorg five unwritten 
rules, models the interaction (we see him instead of Jorg with Ange in the kitchen) 
and also makes him apply the rules in a new situation. The last scene shows Jorg 
mastering rule no. 2 (see Figure 2) in a different interaction with Ange. 

Jorg manages to apply the five rules but neither his nor Duncan’s behaviour is 
assimilistic. Throughout the dialogue he interjects in German (highlighting his 
objection). He defends his own cultural needs and after rule number four he seems 
to give up. He breaks out in a sweat and declares: “I think from now on I will just 
stay in my room”. The ending indicates that he is keeping his sense of humour 
when applying rule number two. Duncan for his part acknowledges that he finds 
the directness he experiences in Germany “quite refreshing”. 

Figure 2. The Tea Towel Stinks on Vimeo 3 



3.4. Reactions 


3.4.1. Reactions from blog and Mimeo 

Lifeswap is published on the producers’ blog, their Facebook page and on Vimeo, 
providing viewers with the option of commenting and sharing the stories. Kiwis, 


3. https://vimeo.com/81393966 


29 










Antonie Aim 


Germans, bi-cultural couples and families, and German teachers in New Zealand 
sympathise and identify with the characters and laugh about themselves. The 
‘amateur online interculturist’ responds to the feedback and encourages viewers to 
send him their own stories: 

• Love this series! Episode 2 reminds me of an incident in my own house 
recently! 

• This episode is awesome - I can def relate :) I can give you heaps of 
inspiration if needed - being a German married to a Kiwi, communication 
can get fuzzy at times :P 

• Thanks. Would love to hear your experience! Fuzzy is a great word for it. 
3.4.2. Reactions from students 


Used as a warm-up in a language class on intercultural mis/communication, some 
students of my intermediate German class wrote about the episode in their blog 
(weekly blogging was an integral part of this class). They related the five rules of 
the episode to their own observations of indirectness in their flats, one involving a 
dirty tea towel and the other an empty water tank (Figure 3 and Figure 4). Student 
A from New Zealand is now noticing a behaviour that she had not noticed before. 
The comment is written by an exchange student from the Czech Republic who 
found the indirectness irritating. The Lifeswap episode put these behaviours in 
perspective and made “the strange familiar [student B] and the familiar strange 
[student A]” (Byram, Gribkova, & Starkey, 2002, p. 19). 


Figure 3. Blog post from student A 



Das Geschirrtuch 



chricht senden ft Blog anzeigen 


Ich habe nicht viele Erfahrungen mit interkulturellen Missverstandnissen, aber ich weiO dass Deutsche und 
Neuseelander anders sind. Zum Beispiel ist das Stereotyp dass die Neuseelander gar nicht direkt sind. Wlr 
haben diesen Folge von Lifeswap ..The Tea Towel Stinks" in der Klasse angeschaut, und dann ist das mir 
passiert. Der Freund emer Mitbewohnerin hat uns geholfen mit das Geschirr ab zu spulen. Das Geschirrtuch, 
das er benutzte, war dreckig, aber er hat nicht sofort gesagt das er ein neues brauchte. Er fragte zuerst ob er 
dieses Geschirrtuch benutzen solle, aber dann fing er trotzdem an zu helfen. Noch einer Weile hat er ganz 
hbflich gefragt ob es noch ein Geschirrtuch gab. Ich fand das ganz interessant, weil er hat genauso gemacht, 
wie der Neuseelander in der Sendung empfohlen hat. Wenn man In Deutschland war, und sowas machen 
wurde, dann wurden die Deutscher einfach nicht verstehen warum man so viel redet um so ein einfaches 
Pnobleme zu losen. Und es geht auch umgekehrt, wenn ein Deutscher hier ist, und einfach sagt was er denkt, 
dann scheint es als ob er sehr unhoflich ware. Solche Unterschieden zwischen Kulturen sitzen sehr bef, und es 
kann schwierig sem, die zu bemerken. Ich denke aber dass es sehr wichtig ist, die Unterschieden zu erkennen, 
sonst erfahrt man viele Missverstandmsse. Meiner Meinung nach ist dass es auch unhbflich ist, sich nicht 
uber der anderen Kultur, in der man reist, zu inform ieren. 
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Figure 4. Comment from student B 


gastern passiert. Mem Mitoewonner nat mic mir b minuten gesprocnen una nac mir an 
Paar komische Frage uber mein Studium gestellt nur am Ende mir zu sagen, dass er kein heifles 
Wasser am Abend hatte, well ich (vielleicht) a lie verbraucht habe :0 ("Aber vieilach ist es mein 
Schuld...") Er hat wirklich traung ausgesehen, dass er mir fragen muss, ob ich das n^chste Mai 
kuerzer duschen koennte :) 


Kommentar von 8. M3rz 2015 um 5:23pm 

Hana, es ist so lustlg, svie hoflich und vorsichtig die Neuseelander sirvd. Mir ist auch etwas 


4. Conclusion 

I have described the makers of the animated web series Lifeswap as amateur 
online interculturists. The intercultural interactions they portray in their episodes 
are based on personal anecdotes. They use humour to address intercultural 
differences, which has a harmonising effect. Comments indicate that viewers 
sympathise with the characters. For intercultural language education, however, 
it is crucial that these issues are problematised. The two-sided approach of 
Lifeswap (both cultures are explored) in particular invites investigations of both 
the ‘self’ and the ‘other’. 
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Abstract. Language learning has witnessed a series of changes with regards to 
the use of Information and Communication Technology (ICT). Recently, the 
digital divide has been a topic of discussion in language learning studies. Digital 
divide is the inequality that exists between information-poor and information-rich 
communities. Within the field of Computer-Assisted Language Learning (CALL), 
scant literature exists regarding the use of technology in poor ICT contexts. Yet, 
many people learn and teach language in such contexts. Egbert and Yang (2004) 
define low-tech context as possessing limited general access to technology, limited 
or no Internet access, no software, old and mandated software, and few computers 
and other technologies. Following action research design, we implemented a small- 
scale intervention using game-based quizzes in order to address the challenges 
encountered in teaching Turkish in a limited-tech context. Data collected included 
questionnaires, focus groups and participant observation in the classroom. The 
findings of the study informed the opportunities and challenges of teaching and 
learning Turkish in a technology-limited classroom. 

Keywords: student response system, low-tech context, game-based quiz, Turkish 
language. 


1. Introduction 

Language learning has witnessed a series of changes with regards to the use of 
ICT. At the end of the twentieth century, CALL is characterised by high speed 
internet connections, advances in digital technology and smaller sizes of computer 
hardware, laptops, multimedia mobile phones, tablets and improved learning 
environments such as web 2.0, etc. (Borau, Ullrich, Feng, & Shen, 2009; Parmaxi, 
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Zaphiris, Papadima-Sophocleous, & Ioannou, 2013). While some people have the 
opportunity of using the above wide range of technology in language learning, 
others find it difficult to access and use them. Hence, there is a demarcation between 
those that have access to technology and those that do not. This demarcation 
is referred to as a digital divide. Recently, the digital divide has been a topic of 
discussion in language learning studies and is defined as the divide between those 
who can effectively use new information and communication tools, such as the 
Internet, and those who cannot (Knobel, Stone, & Warschauer, 2002). Following 
Egbert and Yang’s (2004) characteristics of low tech context as possessing limited 
general access to technology, limited or no Internet access, no software, old and 
mandated software, and few computers and other technologies, we classified the 
Turkish class in a public school in the Republic of Cyprus as a low tech context. 
It is against this background that this research sets out to investigate whether there 
are benefits and setbacks associated with learning Turkish in such a context. In 
an attempt to infuse technology in a low-tech context, we employed ‘Kahoot!’, a 
free game-based learning platform that makes it fun to learn using a collection of 
questions on specific topics, as an appropriate option. In the following sections, 
we describe the methodology employed, followed by major results and major 
conclusions drawn from this research. 


2. Methodology 

2.1. The setting 

The study took place in a public school in the district of Larnaca, in the Republic 
of Cyprus. The group consisted of nine students from eight to 54 years old aiming 
to learn Turkish at A1 level. A questionnaire for measuring students’ digital literacy 
and attitude towards educational technology lead to the conclusions that none of 
the students had used technology for educational purposes before, although they 
recognised its benefits. The classroom was equipped with old and new computers, 
slow wired Ethernet internet connection and a projector. The classroom had no 
Wi-Fi connection. 

2.2. Research design and data collection 

The study was based on action research and data was gathered with the mixed 
method of participatory observation, semi-structured focus group, and discussion, 
in the frequency of two weekly 90 minute lessons, for a total of 13 weeks. 
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The instructor employed Kahoot! as a means to foster students’ engagement and 
motivation in the language classroom. Kahoot! was selected as it was an easy 
solution for creating fun and interactive activities for students, with a website 
that was easy to use and navigate. Moreover, Kahoot! allowed for the existing 
technologies available in the class to be used - projector and desktop computers 
with slow internet connection. In this study, the instructor created quizzes in 
Kahoot! related to the topics of each lesson. The aim was for Kahoot! to facilitate 
learning, and assess students’ grammar and reading skills within a friendly and 
comfortable environment. As there was no Wi-Fi access, students were participating 
in the quiz via the desktop computers. The quiz was played during the last twenty 
minutes of each lesson. The questions were based on the material taught during 
the lesson, allowing for students to playfully assess their reading and grammar 
skills in Turkish. A question had four possible answers, and after every question 
students and instructor discussed the responses since they were able to see their 
mistakes and correct answers. Due to low internet connectivity and insufficiency of 
computers, students would work in groups for replying to a Kahoot! quiz. 


3. Results and discussion 

The analysis of the focus group and participant observation revealed several 
challenges addressed in the low-tech environment. Students’ diverse personal 
motivations and abilities due to the age difference was an initial challenge in this 
study. Younger students would learn Turkish upon their parents’ choice. On the other 
hand, students around the age of 20, chose the Turkish language as they thought it 
would enhance their professional development and the age bracket of 40+ would 
learn Turkish as a hobby. Moreover, it was observed that younger students needed 
more time to understand grammatical rides, compared to adult learners. Building 
on this challenge, and especially on students’ diverse skills, interests, motivations, 
goals, and abilities, the instructor of this course employed a game-based quiz 
for providing an interactive and playful means for encouraging students to work 
together using the available technology in the classroom. Technology appeared to 
bring younger and older learners together towards a common venture; to correctly 
answer a Kahoot! quiz. Younger students would contribute to the use of technology 
and adult learners would contribute to questions related to grammatical rules. Adidts 
who stated at first that the use of educational technology was new for them and 
could not realise if there would be any improvement in their language skills, were 
finally convinced and inspired by the younger ones who were excited and not afraid 
of the unknown. As stated in the focus group, the colourful environment of Kahoot! 
helped the visual learners remember important features of the Turkish grammar. 
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During the game, and after every round of questions, students were discussing their 
answers and gave feedback. Students noted that the feedback given after every 
question would help them understand and have a clear view of the new features 
taught during the lesson. All students agreed on the added value of technology in 
making their learning more interesting. They also enjoyed the fact that Kahoot! 
was played at the end of the lesson and it was a clever way of both assessment and 
learning. Simultaneously, the metacognitive ability was increased while students 
were trying to explore the use of technology and also find the correct answer using 
their language skills. Overall, students expressed enthusiasm and excitement while 
interacting with the game, and despite the difficulties encountered (e.g. low-internet 
connectivity) they successfully managed to engage with the activity. 

The lack of specialised manpower was counted as an additional challenging factor, 
since a non-specialized on educational technology teacher integrated technology 
in a low-tech context. From the instructor’s side, the use of technology entailed 
a series of concerns connected to its practical application and pedagogical 
grounding, regardless of audience’s age and motivation. The role of the teacher 
was crucial in forming the activity in such a way that would convince students 
that technology could be an effective means of language learning. In order to do 
so, the instructor of this course dedicated time for managing the technology and 
linking it with students’ interests. Kahoot! also allowed the teacher to informally 
assess students’ performance and intervene for providing additional explanation 
were needed. 


4. Conclusions 

The aim of this study was to evaluate challenges and opportunities in teaching 
Turkish in a low-context environment. This study concluded that, despite the 
challenges, low-techs contexts can give more opportunities than a no technology 
context. Evaluating the challenges and taking advantage of the opportunities by 
using any available technological tools, can still transform a traditional language 
classroom to a modern one. Challenges addressed include lack of specialised 
manpower, insufficient time for practice, mixed age group and diverse personal 
reasons for attending the course. In addressing the aforementioned challenges, the 
use of game-based quizzes was conceived as a playful way for bringing students 
closer and creating a group environment. Upon its use, several opportunities 
arose for enhancing students’ concentration, allowing for mastery of the limited 
technology, an increased metacognitive ability, and adequate interaction in the 
classroom. This study demonstrates that despite the challenges, teachers in low- 
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tech are encouraged to be more resourceful and be involved in in-service training 
in order to inform their practice with research findings. 
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Abstract. This paper describes how beginners of Icelandic as a foreign and second 
language responded to playing the first scene in Virtual Reykjavik, a video game¬ 
like environment where learners interact with virtual characters - Embodied 
Conversational Agents (ECAs). This game enables learners to practice speaking and 
listening skills, to learn about the language and culture by solving various tasks. A 
mixed-method pilot study examined how six learners responded. The results were 
divided into how learners perceived (1) playing the game in general; (2) interaction 
with virtual characters; (3) multimodal behaviour of the virtual characters, in 
particular the speech, facial expressions, hand gestures and body movements; 
and (4) what the game helped them learn. In conclusion, some learners reported 
they learned to start speaking in Icelandic and that the spoken behaviour of virtual 
characters resembled real Icelanders. 

Keywords: computer games, embodied conversational agents, multimodal 
behaviour, natural language, virtual learning experience. 


1. Introduction 

Virtual Reykjavik is an online language and culture training application 
(Vilhjalmsson, 2011) designed for beginning adult learners of Icelandic as a foreign 
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or second language. This video game-like environment enables learners to practice 
spoken language by talking to virtual characters and listening skills by listening to 
the virtual characters’ answers. Conversational interactions are a good source for 
authentic language input (Krashen, 1982) and output (Swain, 2007) with potentials 
of developing learner’s language skills (Ellis, 1991). Speaking is realised by means 
of Google speech recognition service for Icelandic; the speech is automatically 
transcribed for learners to read what has been said in a lower text window. Character 
responses are synthesised using the Ivona Text To Speech (TTS) system for Icelandic. 

The current version uses game-based learning (Meyer, 2009), task-based learning 
(Ellis, 2003), and a communicative approach (Richards, 2006), supporting learning 
of new vocabulary through text windows of cultural information and transcribed 
dialogues. The main menu is in Icelandic, where learners can hover over words 
with a mouse cursor and see their English translation. Learners can find cultural 
information about selected buildings and monuments in a pop-up window when in 
pause or ‘freeze’ mode. 

Figure 1. Approaching strangers in Virtual Reykjavik 



The virtual characters are designed to look and act lifelike (Prendinger & Ishuzuka, 
2004). In this context, they are also called EGAs because of their embodiment 
within a virtual environment, taking human form, and knowing how to use their 
body in conversations (Cassell, 2000). They are able to “grasp situations, react to 
contingencies and look aware of their surroundings” (Pedica & Vilhjalmsson, 2012, 
p. 1). Their social and conversational behaviour is multimodal and includes speech, 
facial expressions, hand gestures, head, and body movement. They are designed to 
look natural based on research into real-life behaviour. In this way, learners can get 
familiar with the social behaviour and learn about culture and language remotely. 
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In that respect, Prada and Paiva (2014) suggest that it is important to study human 
social interaction in order to help create a highly interactive exchange between 
human users and virtual agents; the effects are stronger if the artefacts, i.e. agents, 
present autonomous and proactive behaviour. About 144 video recordings capturing 
first encounters between native and non-native speakers in the same conversational 
situation as in this game were collected in downtown Reykjavik and analysed. This 
multimodal corpus provided authentic data for a discourse modelling. Specific 
communicative functions and behaviours associated with those functions were 
implemented into the architecture of the system that the virtual characters use to 
generate behaviour, allowing for a more realistic human-to-agent interaction. 

In the first scenario, currently including only one scene, Tynda hljomsveitin [The 
Lost Band], and one chapter, Hvar er Hitt Husid? [Where is Hitt Husid?], learners 
have three tasks to solve: (1) approach a virtual character, who is a native speaker 
of Icelandic and get his/her attention by greeting appropriately (Figure 1); (2) ask 
for directions to a particular place; and (3) say goodbye. 


2. Method 

A mixed-method approach consisting of a questionnaire, an interview and a video 
recording of each participant while playing was used. The pilot study took place 
in a laboratory setting. Participation was anonymous and informed consent was 
obtained. Six learners of six different nationalities participated; four female and 
two male, aged 22-31; three were temporary and three permanent residents. Five 
were beginners and one a false beginner (intermediate); their level of Icelandic was 
A1 on the Common European Framework of Reference for languages. 

The objectives focused on examining how learners perceived: (1) playing the game 
in general; (2) the interaction with virtual characters that possess communicative 
skills based on conversations between people in the real-life situations, because 
interacting with such agents may promote communication skills (Johnson et al., 
2004) and facilitate learning (Shaw, Johnson, & Rajaram, 1999); (3) the multimodal 
behaviour of the virtual characters; and (4) what the game helped them learn. 


3. Learner’s perception and learning effect 

The residts indicated that half of the learners found playing the game enjoyable and 
exciting, while two of six described it as frustrating and boring, and one as neither. 


39 




Branislav Bedi, Birna Arnbjornsdottir, Hannes Hogni Vilhjalmsson et al. 


The enjoyment and excitement referred to the learners being able to talk to virtual 
characters and see what they were going to say. Frustration was mostly caused by 
the speech recognition not handling improper pronunciation of certain consonants, 
e.g. <k> instead of <R>, and due to speaking too softly or fast into the microphone, 
but also by its lagging; moreover also by the lack of information about the goals 
of the game and not being able to ask questions other than those given in the tasks. 
Learners perceived boredom mostly due to the slow movement of the avatar. Two 
of six learners found the game easy and four as neither easy nor difficult. None of 
them found the game difficult. 

Regarding the specific multimodal behaviour (Figure 2), spoken language was 
perceived as the most natural and variation was important: “[I]t wasn’t just one 
godan daginn [good day, with definite article], but also godan dag [good day, without 
definite article] as well, so it seemed like you were actually speaking to someone”. 
However, it was pointed out that in some cases the virtual characters did not respond 
adequately to all forms of greetings, such as blessud [greeting a female], blessadur 
[greeting a male], etc. The reason is due to lack of informal greetings. Two learners 
described the facial expressions as robotic. Some learners also described the body 
movement as spontaneous. Hand gestures were registered only during pointing when 
virtual characters were giving directions or crossing their arms. 

Figure 2. Perception of specific multimodal behaviour 

■ Robotic ■Neither ■Natural 


Spoken language 


Facial expressions 


Hand gestures 


Body movement 



Regarding the overall multimodal behaviour (Figure 3), some learners commented 
that when speaking to virtual characters they had difficulties being understood; 
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also some virtual characters when standing on their own looked like “I-don’t- 
wanna-talk-to-you kind of’. In addition, there was a slow pace of moving around; 
the interaction was sometimes distracted by focusing on the red speaking button, 
which signalised when the learner could speak; the interaction felt natural by half, 
but on the other hand cold by more than a half of learners mainly due to the lack of 
emotion expressed by the characters. 

Figure 3. Perception of the overall behaviour 



■ Participants 


The game had a reported educational effect on five out of six learners; learning 
about famous places in downtown Reykjavik and to start talking in Icelandic. 
One learner found it pointless because of pronunciation issues and experiencing 
difficulty being ‘not understood’. Overall, four learners stated that once the game 
is ready, it would help others learn about buildings and monuments and make it 
easier to start speaking and communicating in Icelandic. They felt that a virtual 
environment would be easier than learning in reality with real people face-to-face. 


4. Conclusion 

Five out of six learners found the game educational, of which three learners 
reported they learned (1) spoken language skills when initiating a conversation, 
and (2) about cultural sights and buildings in downtown Reykjavik. A gap 
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between a passive and an active use of language can be bridged when learners 
get to practice the language in a conversation with virtual agents. Quoting 
from one learner: “I think it’s very helpful, like when [the game] would be 
done, [...] especially in practicing conversations, because when you learn a 
language the hardest part is to start speaking”. In this way, the game may help 
facilitate face-to-face communication in reality. The game’s ultimate goal is to 
promote learning of language and culture based on real language use with virtual 
characters acting like native speakers. However, the multimodal behaviour needs 
to be fine-tuned yet. Adding a smile at the end of a conversation, which can 
also be observed in recordings from real life, can make the virtual characters 
friendlier. It is, nonetheless, difficult to draw a general conclusion on whether 
or not the design of virtual characters can have a similar effect on learners in 
another computer game. Since the aim of the Virtual Reykjavik project is to 
create lifelike virtual characters with natural multimodal behaviours, more focus 
must be placed on incorporating those into the system, and more research needs 
to be done in real-language data to reach perfection in modelling believable 
embodied conversational agents for language learning games. 


References 

Cassell, J. (2000). Nudge, nudge, wink, wink: elements of face-to-face conversation for embodied 
conversational agents. In J. Cassell, J. Sullivan, S. Prevost, & E. Churchill (Eds), Embodied 
conversational agents (pp. 1-27). Cambridge, MA: MIT Press. 

Ellis, R. (1991). The interaction hypothesis: critical evaluation. Paper presented at the Regional 
Language Seminar, Singapore, March 1991. Eric - US Department of Education. http://files. 
eric.ed.gov/fulltext/ED338037.pdf 

Ellis, R. (2003). Task-based language learning and teaching. Oxford University Press. 

Johnson, W. L., Choi, S., Marsella, S., Mote, N., Narayanan, S., & Vilhjalmsson, H. (2004). 
Tactical language training system: supporting the rapid acquisition of foreign language and 
cultural skills. In Proceedings oflnSTIL/ICALL - NLP and Speech Technologies in Advanced 
Language Learning Systems, June 17-19, Venice. 

Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon Press. 

Meyer, B. (2009). Designing serious games for foreign language education in a global 
perspective. In A. Mendez-Vilas, J. Mesa Gonzalez, J. A. Mesa Gonzalez & A. Solano 
Martin (Eds), Research, reflections and innovations in integrating LCT in education (Vol. 
2, pp. 715-719). 

Pedica, C., & Vilhjalmsson, H. H. (2012). Lifelike virtual characters using behavior trees for social 
territorial intelligence (Demo/Poster). In Proceedings of ACM SLGGRAPH'12, Los Angeles, 
August 5-9. http://www.ru.is/kennarar/hannes/publications/SIGGRAPH2012_poster.pdf 


42 




Learning Icelandic language and culture in Virtual Reykjavik: starting to talk 


Prada, R., & Paiva, A. (2014). Human-agent interaction: challenges for bringing humans and 
agents together. In HAIDM - 3rd International Workshop on Human-Agent Interaction 
Design and Models held at AAMAS’2014 - 73th International Conference on Autonomous 
Agents and Multi-Agent Systems. Paris, France. 

Prendinger, H., & Ishuzuka, M. (Eds). (2004). Introducing the cast for social computing: life-like 
Characters. In ). H. Prendinger & M. Ishuzuka (Eds), Life-like characters: tools, affective 
functions, and applications (pp. 3-16). New York, NY: Springer.. 

Richards, J. C. (2006). Communicative language teaching today. Cambridge University Press. 

Shaw, E., Johnson, L., & Rajaram, G. (1999). Pedagogical agents on the Web. In Proceedings of 
the third annual conference on Autonomous Agents, AGENTS’99 (pp. 283-290). New York, 
NY: ACM. 

Swain, M. (2007). Falagstilgatan: KenningarogRannsoknir. In A. Hauksdottir& B. Ambjornsdottir 
(Eds), Mai malanna (pp. 117-136). Reykjavik: Stofnun Vigdisar Finnbogadottur i erlendum 
tungumalum. 

Vilhjalmsson, H. H. (2011). Icelandic language and culture training in Virtual Reykjavik. The 
Icelandic Research Fund 2012. Project Grant - New proposal (pp. 1-13). 


43 




EUROO 

H 

Investigating student choices in performing 
higher-level comprehension tasks using TED 
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Abstract. The current paper describes a first experiment in the use of TED talks and 
open tagging exercises to train higher-level comprehension skills, and of automatic 
logging of the student’s actions to investigate the student choices while performing 
analytical tasks. The experiment took advantage of an interactive learning platform 
- Learn Web - that integrates TED talk videos and transcripts and enriches them 
with tagging features and a data logging system. The data collected offered an 
answer to the following questions: Which of the three tasks was perceived by the 
students as more difficult? flow was each task faced by the students? How did 
the logs contribute to an understanding of the students’ approaches to the tasks? 
The experiment also suggested ideas for further development of Learn Web’s log 
features from a pedagogical and research perspective. 

Keywords: TED talks, Learn Web, design-based research, log analysis. 


1. Introduction 

Learn Web 3 (Marenzi, 2014) is an educational platform designed for retrieving, 
sharing, commenting and analysing multimedia resources. This platform has recently 
integrated TED talks (Taibi et al., 201 5) and enhanced TED transcripts with interactive 
features (e.g. text selections, annotations, and deletions; Bianchi & Marenzi, 2015). 

This experiment tested the newly integrated features within an academic module 
on interpreting. The module trains core skills, which include active listening and 
memorization. Learn Web was thus used to give students exercises targeting higher- 
level comprehension skills, and to gain insight into the student choices while 
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performing the given tasks. The following research questions led the analysis of 
the data: Which of the three tasks was perceived by the students as more difficult? 
How was each task faced by the students? How did the logs contribute to an 
understanding of the students’ approaches to the tasks? 

Below is a brief outline of the conceptual models which informed the exercises and 
the analyses in the current experiment. 

Discourse comprehension, memorization and summarization are fundamental skills 
in interpreting (Pochhacker, 2003), and expert trainers, such as Moser-Mercer 
(2000), suggest that an interpreter’s training should start from there. According to 
van Dijk and Kintsch (1983), comprehension, memorization and summarization 
involve the creation ofthree types ofmental representations: surface representations, 
focusing on microstructures; textbase representation, containing macrostructural 
information; and situation model , integrating text information with experience of the 
world. Macrostructures are created by applying processes of deletion, generalization 
and construction. Elaborating on van Dijk and Kintsch’s (1983) model, Brown and 
Day (1983) suggest six macrorules for text summarization: (1) deleting unnecessary 
information, (2) deleting redundant information, (3) substituting a list of items 
with a superordinate word, (4) substituting a list of actions with a word expressing 
a superordinate event, (5) selecting a topic sentence, and (6) inventing a topic 
sentence if none are available. Strategies involving substitution and construction are 
not used by less experienced readers (Winograd, 1983). Focus on text structure, i.e. 
the textbase representation, and deep understanding of the intended meaning of the 
text are fundamental in consecutive interpreting (Hatim & Mason. 1997). 


2. Method 

The experiment involved 25 Italian natives, attending a module on consecutive 
interpreting in an MA curriculum for language specialists. The students - aged 21- 
23 (except for one student aged 47) - were B2+ or above of the CEFR in English. 

The students were given three tasks revolving around the same TED video. Task 
1 asked them to divide the first six minutes of the video into five sections and 
give them a title. This task involves the creation of a textbase representation and 
requires the students to verbalize it, thus gauging understanding and summary 
skills. Task 2 asked the students to analyse the same piece of text and distinguish 
key assertions from ancillary pieces of text. This task draws attention to and 
requires the application of one of the most basic reading and summary strategies, 


45 




Francesca Bianchi and Ivana Marenzi 


i.e. deletion. Finally, Task 3 required the students to mark each clause in the first 
three minutes of the speech with a discourse function chosen from a given list. 
This task draws attention to the communicative function of discourse, and involves 
abilities at the level of textbase representation and situation model, not to mention 
metalinguistic abilities. For more details, see Bianchi and Marenzi (2015). 

The tasks were performed using Learn Web’s selection and annotation feature, 
pictured in Figure 1. 

Figure 1. The annotation window 



LearnWeb keeps track of the student’s selections, deselections and annotations 
by means of a logging system and provides the teacher with a detailed log and a 
simple log. 


3. Discussion 

Due to some technical issues, only 14 resources in Task 1,15 resources in Task 2, 
and 13 resources in Task 3 were suitable for analysis, along with the corresponding 
logs. The following paragraphs present the results, organized by research question. 

3.1. Which of the three tasks was perceived 

by the students as more difficult? 


To answer this question we used the detailed log, and manually counted the 
cases where a student had deselected a piece of text and subsequently changed 
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the selection span or the annotation. The percentage of students who substantially 
changed at least one selection or tag was 29%, 7%, and 38% in Tasks 1, 2, and 3, 
respectively; the number of substantial changes recorded was, respectively, seven, 
one, and eight. These data suggest that Task 2 was considered much easier than the 
other ones. Tasks 1 and above all Task 3, on the other hand, posed problems to the 
students, with Task 3 recording a higher number of substantial changes across a 
higher percentage of students. 

These results quantify and reflect the students’ confidence in the given skill. 

3.2. How was each task faced by the students? 

In Task 1, almost all the annotations matched Brown and Day’s (1983) macrorule 6 
(i.e. inventing a topic sentence), and involved strategies of substitution and creation. 
Furthermore, the students’ annotations were structured as long phrases (47%), 
complete sentences (38%), or wh questions (15%). These techniques suggest good 
summary skills and are also suitable to support memorization (see e.g. Taboada & 
Guthries, 2006; Urlaub, 2012). 

In Task 2, the students’ unit of reference was the paragraph (47%), the sentence 
(20%), or a mix of the previous two (33%). Considering key elements entire 
paragraphs of a text, though theoretically possible in some contexts, is not the 
best approach in the current scenario. Furthermore, 13% of the students used 
inappropriate tags. 

In Task 3, 77% selected and tagged full sentences or paragraphs instead of clauses, 
thus showing little sensitivity for discourse functions and limited familiarity with 
this type of pragmatic task. The students’ deselections and changes of tag were 
primarily located towards the beginning of the text. These results suggest that 
Task 2 was actually the most difficult, while Task 1 the easiest. 

3.3. How did the logs contribute to an understanding 
of the students’ approaches to the tasks? 


The detailed log proved fundamental to: understand whether a student had 
hesitations while performing the task; see the order in which selections and 
annotation were made; and understand the beginning and end of selections when 
multiple selections and tags appeared in contiguous pieces of text. 
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Due to the same technical issues that led to discarding some of the students’ 
resources, the simple log could not be used in the current analyses. 


4. Conclusions 

The current paper has shown a possible use of Learn Web’s interactive features 
and logs to gauge higher-level comprehension skills through selection and tagging 
exercises and the students’ confidence in their own skills. 

The results suggest that a large number of the students in this group had good 
summarising abilities - attested by their annotations in Task 1, based almost 
exclusively on strategies of substitution and creation but little awareness of the 
strategies and skills they automatically apply in the reading process - attested by 
their generally unsuitable selections in Tasks 2 and 3. Furthermore, the limited 
number of changes, especially in Task 2, suggest that most of the students were not 
aware of their limited metacognitive and analytical abilities. 

The analyses were largely based on evidence that was visible in the students’ final 
products, i.e. in the annotated resources. However, the system’s detailed log played 
more than one important role, as summarized in Section 3.3. In particular, it gave 
the researchers access to the draft versions of the students work. 
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Abstract. As stated in Cardoso, Smith, and Garcia Fuentes (2015), second language 
researchers and practitioners have explored the pedagogical capabilities of Text-To- 
Speech synthesizers (TTS) for their potential to enhance the acquisition of writing 
(e.g. Kirstein, 2006), vocabulary and reading (e.g. Proctor, Dalton, & Grisham, 
2007), and pronunciation (e.g. Cardoso, Collins, & White, 2012). Despite their 
demonstrated effectiveness, there is a need for up-to-date formal evaluations of 
TTS systems, specifically for their potential to promote the ideal conditions under 
which languages are acquired, particularly in an English as a Foreign Language 
(EFL) environment, as suggested by Cardoso, Smith, and Garcia Fuentes (2015). 
This study evaluated a modem English TTS system in an EFL context in Brazil, 
at a number of levels, including speech quality, opportunity to focus on form, 
and learners’ cognitive processing of TTS-generated texts. Fifteen Brazilian EFL 
learners participated in the study in which they listened to both human and TTS- 
produced speech samples while performing the abovementioned tasks. Semi- 
structured interviews were used to collect data about participants’ perceptions of 
the technology. We report an analysis of these interviews, which indicate that EFL 
learners have overall positive attitudes towards the pedagogical use of TTS, and that 
they would like to use the technology as a learning tool. 

Keywords: text-to-speech synthesis, TTS, L2 pronunciation, English as a foreign 
language, Brazil. 
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1. Introduction 

Second/foreign language (L2) learners need to be exposed to a significant amount 
of input in the L2 in order to acquire it. The literature suggests that the learning 
process is boosted when learners have access to comprehensible (Krashen, 1985) 
and acoustically variable input (Barcroft & Sommers, 2005) in an environment 
that is learner-centered and that provides multiple opportunities for self¬ 
regulation (Chapelle, 2001). However, EFL students often lack input exposure 
outside the classroom as they do not usually have access to proficient speakers. 
One way to overcome this limitation is via the pedagogical use of TTS in L2 
education, which has been demonstrated to be beneficial for the development 
of writing (Kirstein, 2006), vocabulary and reading (Proctor et al., 2007), and 
pronunciation skills (Cardoso et ah, 2012). 

Despite their demonstrated effectiveness, there is a need for up-to-date formal 
evaluations of TTS systems, specifically for their potential to promote the 
ideal conditions under which languages are learned (e.g. via enhanced input 
environments - Chapelle, 2001). Recently, Cardoso et al. (2015) investigated 
whether TTS systems provided university-level English as a second language 
speakers in Canada with the opportunity to complete focus-on-form tasks, detecting 
English regular past tense marking (i.e. /t/, /d/ or /Id/) in forms such as walked , 
played, and wanted in both human and TTS-generated texts. Findings revealed 
that participants were able to identify the target forms correctly, regardless of the 
type of voice heard. They also examined how students perceived the quality of 
TTS speech in comparison with human speech, and found less favorable ratings 
for TTS-generated texts. They acknowledged, however, that their findings could 
not be generalized to ‘foreign’ language contexts, as their participants were 
native-like English speakers with vast experience with the language. The current 
study, therefore, addresses the following research question: What are learners’ 
perceptions of the pedagogical use of TTS in an EFL context? 


2. Method 

2.1. Participants and design 

Fifteen Brazilian EFL learners (university students or professionals from a 
variety of educational backgrounds and proficiency levels, between the ages of 
16 and 32) were recruited to complete four tasks in order to evaluate the quality 
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of TTS-generated texts: they rated speech quality, answered comprehension 
questions, participated in a dictation, and were asked to identify past -ed forms in 
what they heard. For all tasks, participants listened to speech samples alternately 
produced by TTS and a human. The TTS voice was Julie (by NeoSpeech), a 
female North American speaker, and the human was a female native-speaker 
of the same dialect with similar speech properties. At the end of the one hour 
session (one-shot design), participants were interviewed about their insights on 
the quality of the TTS-generated voices. This paper reports findings from the 
analysis of the interview data. 

2.2. Analysis 

Participants’ interviews were analyzed and categorized into four themes: TTS 
system vs. human voice, speech accuracy, comprehensibility, and potential to be 
used as a learning tool. Under each theme, students’ opinions were labelled as 
positive or negative to depict their overall perception and acceptance of TTS for 
pedagogical purposes. 


3. Results 

3.1. TTS system versus human voice 

Only four participants were able to identify the electronic/human voice opposition 
without prompting: “The first voice was like the Google voice, when you try to 
translate”; “Clearly, there was a computer voice and other that was not”. Eight 
students only realized differences between the two types of voices when they were 
explicitly told that one was machine-made: “Now that you’ve mentioned it, yes. 
Actually, 1 hadn’t stopped to think about it”. The remaining three students were not 
able to differentiate TTS and human voices even when they were told about them: 
“It completely fooled me”, declared a participant. 

3.2. Accuracy 

At the segmental level, TTS was perceived to be as good as native voices: “For 
me, both were speaking as native speakers, both were super correct”. Flowever, 
suprasegmentals were problematic as TTS was seen as unnatural and lacking 
native rhythm in phrasal stress, intonation and pauses: “[the computer voice] 
helped my comprehension, but sometimes words have a different intonation 
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[...] words that should give away phrasal tone [stress]”. One student noticed, 
however, that TTS is efficient for questions since it accurately reproduces the 
rising tone in interrogative clauses. 

3.3. Comprehensibility 

Inaccuracy in suprasegmental production made most participants consider TTS 
harder to understand when compared to the human voice. Nine students stated that 
the pace of the TTS and consequently its intonation patterns and connected speech 
phenomena made it more difficult to understand: “The ‘tempo’ between words [in 
TTS] draws too much attention, because in spoken language you feel more fluidity 
due to different timing between word connections, grammatical constructions [...]. 
With computers, everything seems to have the same timing, so it creates a different 
perception”. Five learners favored TTS because it was slower and made word 
boundaries more salient as it speaks “word by word”. 

3.4. Potential as a learning tool 

11 participants agreed that TTS technology could and should be used as a tool 
for language learning: they perceived that morphological features such as past 
-ed markings were more salient in TTS, and that it could be a source for extra 
input outside the classroom. Three participants suggested that TTS should only be 
used with beginners as more advanced learners need to experience human voice 
characteristics: “People will [need to] get used [to a human voice] because when 
they travel, they won’t hear paused, word by word speech”. Seven participants 
stated that TTS should be used for all levels as long as the human voice is not 
excluded from the learning process. For two students, however, TTS should not be 
used as a learning tool: “I don’t think it is a good idea [...] it’s always better when 
a native teacher speaks”. 


4. Conclusions 

This study investigated learners’ perceptions of the pedagogical use of TTS in an 
EFL context. The findings show that participants had an overall positive impression 
of TTS-generated voices. TTS has evolved significantly in terms of quality in 
recent years to the point that most participants could not tell the difference between 
human voice and TTS until prompted. However, the TTS voice was still rated 
less favorably in terms of comprehensibility when compared to the human voice. 
These findings corroborate previous studies (e.g. Cardoso et ah, 2015; Handley, 
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2009). On the other hand, while the low ratings for comprehensibility may appear 
negative, this had little impact on participants’ perception of TTS as a pedagogical 
tool. Almost all participants recognized that TTS could and should be used for 
teaching purposes, and most said that it shoidd be used regardless of students’ 
proficiency levels. This contrasts to Cardoso et al.’s (2015) findings from a similar 
study conducted in a ‘second’ language context, wherein participants showed 
lower acceptance towards TTS. One reason for this high acceptance of TTS as a 
pedagogical tool in the current study may be due to the fact that EFL environments 
lack naturally occurring L2 input and access to native or proficient speakers in 
the target L2 outside of online environments. With TTS, language learners can 
gain additional exposure and have access to enhanced input environments to 
increase their learning opportunities (Chapelle, 2001). These findings suggest that 
EFL students appear to be ready to adopt TTS systems as pedagogical tools in L2 
education. 
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Abstract. Good practice in primary research has evolved over many decades of 
research in applied linguistics to counter human fallibility and biases. Surprisingly, 
perhaps, synthesising such research in an entire field has only recently started to 
develop its own methodologies and recommendations. This paper outlines some of 
the issues involved, especially in terms of quantitative research and meta-analysis. A 
second-order synthesis of meta-analyses in Computer-Assisted Language Learning 
(CALL) provides only medium effect sizes, but the figures are interpreted in terms 
of realistic expectations. The inevitable variation in effect sizes can be attributed in 
principle either to the research methodologies (both primary and secondary) or - 
more interestingly - to real-world phenomena. 

Keywords: meta-analysis, research synthesis, effect size, variation, CALL synthesis. 


1. Primary studies and research synthesis 

CALL research is often quantitative in nature, in line with the bulk of research 
in applied linguistics which sees measurement as a way to counter subjectivity 
and strive towards more ‘scientific’ rigour. This of course neglects the important 
insights that can only realistically be gleaned from qualitative studies, with their 
more frequent focus on emic, ecological, holistic considerations, and ability to 
account for complex, narrative, continuous data such as interviews which do not 
lend themselves easily to quantitative analysis. This is not to say that quantitative 
research should be abandoned, only that - like all research - it needs using and 
interpreting with caution. 

A particidar problem with primary quantitative research is that many studies adopt 
Null Hypothesis Significance Testing (NHST) as the standard model. NHST is 
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entirely subject to sample size (any difference will be significant if the sample is 
large enough), it doesn’t tell us anything about what we’re really interested in (i.e. 
the effect of a particular variable), and it encourages dichotomous thinking on an 
arbitrary basis (with ^-values typically set at 95% for no good reason). NHST has 
been heavily criticised on all these counts, with Plonsky (2015) claiming it has 
done “far more harm than good” (p. 242). 

More useful are effect sizes such as Cohen’s d: such measures do address the real 
issues, and have the substantial advantage that they can be pooled across studies. 
For this to be effective, we first however need to begin with rigorous trawls of 
research in a clearly-defined field to ensure that we do in fact cover what we 
set out to synthesise. Traditional surveys as found in the ubiquitous ‘literature 
review’ in primary studies are notoriously inadequate if one relies on personal 
interpretation of serendipitous collections. This is a major issue in the complex 
field such as education, where “everything seems to work in the improvement of 
student achievement... Teachers can thus find some support to justify almost all 
their actions - even though the variability about what works is enormous” (Hattie, 
2009, p. 6). Research synthesis and specifically meta-analysis are attempts to make 
the procedures more scientific and transparent (Norris & Ortega, 2000). 


2. Meta-analysis in CALL 

Table 1 is an attempt to summarise meta-analyses in CALL, derived largely from 
Plonsky and Ziegler (2016) and Oswald and Plonsky (2010). The 12 meta-analyses 
show the size of the effect of CALL use in experimental groups compared to control 
or comparison groups. The first three give large effect sizes according Plonsky and 
Oswald’s (2014) empirically-derived, field-specific benchmarks based on meta¬ 
analyses in Second Language Acquisition (SLA) ( d> .9); the next two are medium 
(d > .6), followed by three small (d > .4) and four negligible effects (d < A). The 
mean is .64, the pessimistic conclusion being that CALL work as a whole has 
barely a medium effect on learning. Worse, the few large effect sizes are derived 
from very small samples as shown in the column for k. Indeed, there is a large 
negative correlation (r=-.51) between the number of studies featuring in these 
meta-analyses and the effect size calculated. 

This rather pessimistic discussion is based on the premise that we need to find 
large effect sizes for CALL. Minimally, however, what we would hope to find is 
that CALL is at least as good as traditional teaching, with an effect size of d=0 (or, 
according to Hattie, 2009, <i=.4), which is the case here. Since most primary studies 
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are relatively focused and short-term, they will not show other benefits which 
we may want to impute to CALL. These might include cost or time efficiency, 
motivation or enjoyment, long-term retention or appropriation, learning-to-learn or 
becoming ‘better language learners’, increased autonomy or transferable skills, etc. 
Such conclusions are speculative at best since these things are notoriously difficult 
to research, and would have to be the subject of further studies. 


Table 1. Meta-analyses in CALL (cf. Oswald & Plonsky, 2010; Plonsky & 
Ziegler, 201 6) 


study 

year 

source 

focus 

k 

d 

Abraham 

2008 

CALL 

Glossing vocabulary 

6 

1.40 

Zhao 

2003 

CALICO J 

CALL general 

9 

1.12 

Taylor 

2006 

CALICO J 

Glossing reading comprehension 

4 

1.09 

Chiu 

2013 

BJET 

Vocabulary 

16 

0.75 

Abraham 

2008 

CALL 

Glossing reading comprehension 

11 

0.73 

Chiu et al. 

2012 

BJET 

Game-based learning 

14 

0.53 

Taylor 

2009 

CALICO J 

Glossing reading comprehension 

32 

0.49 

Lin, H. 

2014 

LL&T 

CMC 

59 

0.44 

Yun 

2011 

CALL 

Glossing vocabulary 

10 

0.37 

Lin, W. et al. 

2013 

LL&T 

SCMC 

19 

0.33 

Grgurovic et al. 

2013 

ReCALL 

CALL general 

65 

0.24 

Ziegler 

2015 

SSLA 

SCMC 

14 

0.13 


3. Variation 

Meta-analyses need interpreting with caution: in particular, it is tempting to 
seize on a single figure as the ultimate answer to the question: Does it work? 
“Professionals in CALL often find this comparison question frustrating... but 
in a political sense, it would be useful if CALL specialists could answer it” 
(Grgurovic, Chapelle, & Shelley, 2013, p. 2). More realistically, we need to look 
at variation in what works: different primary studies of ostensibly of the same 
phenomenon will provide different effect sizes - as will different meta-analyses 
in a given field (cf. Table 1). 

Variation in meta-analyses may derive from the studies themselves. Clearly not all 
primary research is of similar quality, and a synthesist has to decide how to deal 
with this - typically by devising a priori inclusion criteria (e.g. whether to include 
conference proceedings), or by treating quality as a variable and subsequently 
examining its impact on the effect sizes (e.g. to compare papers in conference 
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proceedings against those in prestigious journal articles). This underlines the many 
choices that are to be made: quality is a consideration in secondary as much as in 
primary research. The increasing numbers of meta-analyses and the prominence 
given to them in such diverse places as the American Psychological Association 
manual or Language Learning editorials, along with handbooks (e.g. Cumming, 
2012) and websites with methodological recommendations for good practice and 
increasingly sophisticated tools (cf. https://lukeplonsky.wordpress.com), may 
suggest that the practices are straightforward. 

While SLA synthesis may have become something of a tradition in its own right, 
researchers have a tremendous range of options to choose from at all stages. How 
exactly do they define the field? What tools do they use to arrive at a (near-) 
exhaustive collection of studies in that field? What study types do they reject? 
Simply when deciding what studies to include, many meta-analyses are deliberately 
limited to control/experimental designs published in English in high-ranking 
journals in particular time periods for example, and so inevitably miss much of 
the field, the rationale being to increase study quality. How do they extract the 
data, and how do they calculate and interpret effect sizes? Primary research can be 
extraordinarily complex, with several experimental groups doing different things 
using different tools and procedures for different main objectives, and the resulting 
data presented in the form of raw data, descriptive statistics, F/t- scores, etc. The 
synthesist then has to decide the specific formula to use, and decide whether to 
weigh the results (e.g. for sample size) and how to deal with the extreme values 
for outliers. Checking is essential, usually from inter-rater reliability measures, but 
also in the form of funnel plots for publication bias in the studies sampled, and if 
possible, comparing effect sizes from different designs (control/experimental vs. 
pre/post-test and if possible delayed test designs). 

Variation can also be examined to determine which moderator variables contribute 
more or less to overall effect sizes. It might be, for example, that large effect sizes 
only come from long-term studies, or from certain learner populations (proficiency, 
age, sex, cultural background, field of study, etc.), for certain linguistic objectives 
or tools or procedures, and so on. Promising categories therefore feature in 
a coding sheet, which is itself immensely complex and difficult to draw up 
rigorously. It is no surprise perhaps that among the main conclusions of syntheses 
are recommendations for better reporting practices in primary research, as it is 
only at this stage that it becomes really apparent how much information is missing, 
vague or unsubstantiated. Burston and Arispe (2016), for example, found that 50% 
of research articles in four major CALL journals targeting ‘advanced’ levels of 
proficiency had learner populations of B1 level only. 
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4. Conclusions 

Research is extremely complex, not just in terms of choices and procedures but 
also in terms of the field itself - language, language use and language learning. 
Bias is inherent in primary research, and measures need to be taken to ensure that 
this is not exacerbated in an overall view of the field. Quantitative studies provide 
essential insights but do not capture the whole picture, while narrative syntheses are 
“inevitably idiosyncratic” (Han, 2015, p. 411) - both are essential to provide as full an 
understanding as possible. Synthesists need to be rigorously transparent in designing 
their studies, writing up their results, and providing supplementary materials for 
others to check, replicate, or modify as more research becomes available. 

The observations here are in large part inspired from a meta-analysis of data- 
driven learning, i.e. the use of corpora in language learning (Boulton & Cobb, 
forthcoming). In addition to the above, the main conclusions are that the many 
choices are often glossed over; that single-figure main effects can be misleading 
and need careful interpretation; and that, despite the relatively low overall effect 
sizes reported, there are reasons for optimism in the field. Inevitably, more research 
is needed in all areas. 
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Abstract. This paper evaluates the contribution of instructional technology to 
advanced-level foreign/second language learning (AL2) over the past thirty 
years. It is shown that the most salient feature of AL2 practice and associated 
Computer-Assisted Language Learning (CALL) research are their rarity and 
restricted nature. Based on an analysis of four leading CALL journals ( CALICO, 
CALL, LL&T, ReCALL), less than 3% of all CALL publications deal with AL2. 
Moreover, within this body of research, the range of languages involved is very 
restricted. Three languages, English, German and French, account for nearly 87% 
of the studies. Likewise, in nearly 81% of the cases, the learning focus is on 
the written language. Attention to oral-aural skills accounts for only 18% of all 
AL2 CALL projects. Whatever the targeted language or linguistic focus, the most 
striking aspect of advanced-level L2 CALL studies is the lack of information 
given regarding the competency level of students and the linguistic level of 
the activities undertaken. The determination of these critical parameters is thus 
of necessity very much a highly interpretive process. Based on the available 
evidence, it is estimated that half of the learners in these AL2 studies were in fact 
within the Common European Framework of Reference (CEFR) B1 range, i.e. 
below what would generally be considered as advanced-level competency. So, 
too, half of the assigned tasks were deemed to have been below the B2 level, with 
40% of these below the B1 level. This study concludes that both quantitatively 
and qualitatively the contribution of instructional technology to advanced-level 
L2 acquisition has been very limited. 
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1. introduction 

This paper evaluates the contribution of instructional technology to AL2 over the 
past 30 years. It draws upon 47 Advanced-level second language papers found 
in four prominent journals ( CALICO, CALL, LL&T, ReCALL), which constitutes 
2.6% of their total 1840 publications from 1983 to 2015. At 5.3%, LL&Thad the 
greatest proportion, with CALICO at 3.7%, ReCALL at 3.2% and CALL at less 
than 1%. 

The CALL literature in this study includes only seven AL2, with English as a 
Foreign or Second Language (EFL/ESL) alone accounting for nearly 62% of 
all publications (Figure 1). This is followed in a distant second and third place 
by German (13.5%) and French (11.5%). Four other languages complete the 
inventory: Spanish (6%), Chinese (4%), and Arabic and Russian at less than 
2% each. 

Figure 1. Advanced-level languages 


Arabic 1.9% 



Figure 2. Pedagogical focus 
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Pronunciation m 
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In all, nearly 81% of AL2 studies focused on the written language (Figure 2), of 
which presentational and interpersonal writing accounted for 63% and reading 
18%. In contrast, presentational and interpersonal speaking, pronunciation and 
listening together were targeted in only 18% of the studies. One paper focused on 
basic grammar. 


2. Pedagogical focus details 

2.1. Written language 

Beginning with the predominant written language paradigm, a closer inspection 
of the 24 AL2 studies that focus specifically on presentational writing skills 
reveals that 13 involve collaborative composition activities [3, 13, 14, 19, 22, 24, 
27, 29, 30, 36, 39, 40, 43] 3 and 11 individual writing exercises [4, 5, 6, 7, 9, 11, 
23, 32, 37,41,47], 

A number of the studies that specifically target presentational writing [29, 30, 
36, 40] also involve written interpersonal communication. However, ten of the 
written interpersonal communication studies [1, 2, 10, 17, 25, 26, 35, 38, 42, 
44] focus on text-based Computer-Mediated Communication (CMC) (i.e. chats, 
discussion forums, blogs) which target interaction that does not result in any 
formal written production. The emphasis on the written language is further 
extended in ten studies that target reading comprehension of online texts [12, 15, 
16, 18, 20,28,30,33,34,37], 

2.2. Other language areas 

In all, only ten studies devote any attention to aural/oral skills. Only one study [30] 
focuses on presentational speaking, in combination with presentational writing. In 
all, four studies involve interpersonal speaking, three [24, 30, 36] in conjunction 
with presentational writing and the fourth [31] with listening comprehension. 
Besides the latter [31], three other studies also target listening comprehension [8, 
30, 45]. The tenth aural/oral study [21] involved pronunciation correction. Lastly, 
one study was grammar-based [46]. 


3. In order to not encumber the text with long bibliographical citations, references in this meta-analysis are made to the number 
in square brackets which precedes each entry in the References section. 
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3. Student language competency level 

The AL2 CALL publications in this study are frustratingly imprecise in identifying 
the language competency level of students. Of the forty-seven papers involving 
pedagogical implementations analysed in the present study, only nine [15, 16, 17, 
21, 27, 33, 37, 46, 47] explicitly substantiate student L2 competency by reference to 
objective external test results (e.g. TOEFL scores). Another 12 [2, 7, 8, 10, 11,12,24, 
28, 31, 34, 35, 39] specifically identify the competence level of their students (e.g. 
advanced-low, Bl, etc.), but without any corroborating evidence. In the remaining 
26 studies [1, 3, 4, 5, 6, 9, 13, 14, 18, 19, 20, 22, 23, 25, 26, 29, 30, 32, 36, 38, 40, 
41, 42, 43, 44, 45], the competency level of students can only be determined based 
on circumstantial evidence (e.g. graduating L2 majors, students in an AL2 graduate 
course, etc.). As can be seen in Figure 3, based on the information that could be 
gleaned from these studies, the competence level of half the students described as 
advanced-level learners was in fact within the B1 range on the CEFR scale, which 
is to say at a level where they coidd at best ‘communicate essential points and ideas 
in familiar contexts’. Only a third of the students were in the B2 range, i.e. a level 
generally acknowledged as advanced. The remaining 17% were at the Cl level, i.e. 
‘effective operational proficiency’. 

Figure 3. Student L2 competency level 



4. Language activity level 

Even more so than with the definition of advanced-level competence in the 
description of AL2 CALL studies, identification of the linguistic level of the 
actual language activities undertaken by students in the projects leaves much 
undetermined. In fact, of the 47 implementation studies, only one [34] explicitly 
identified and substantiated task level with reference to an objective external 
metric. Three others [9, 12, 43] defined the task level explicitly, but without any 
substantiation. The task level of the remaining 43 (92%) could only be determined 
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through interpretation of the activities undertaken. In all but two cases [38, 40], this 
nonetheless provided a reasonable estimate of task difficulty level upon which the 
following analysis is based. 

As indicated in Figure 4, the estimated range of language activity levels in AL2 
CALL studies extends from A2 to Cl, of which half are below the B2 level. 

Figure 4. Task level 



5. Conclusion 

In evaluating the contribution of CALL to advanced-level foreign/second language 
instruction, this study has considered a number of interrelated factors as manifested 
in the published research of the four most prominent CALL journals ( CALICO, 
CALL, LL&T, ReCALL ) over the past thirty years. As documented, AL2 barely 
merits a mention in the published CALL literature. Moreover, such research as 
exists is extremely limited in the L2 studied, with English by far being the center of 
attention, followed distantly by German and French and four other languages. So, 
too, four times as many studies focus on the written language compared to aural- 
oral skills. Even more seriously, AL2 CALL studies are plagued by vagueness as 
to what constitutes an advanced level of foreign language competence and the 
difficulty level of the language activities their students were required to undertake. 
Notwithstanding, a close analysis of these studies allows these critical parameters 
to be determined with reasonable accuracy. Specifically, it is shown that in half the 
cases student competence and their assigned tasks were advanced only to the extent 
that they were above the A2 level. In sum, it must be concluded that to date, CALL 
has contributed very little to either our understanding or practice of advanced-level 
foreign/second language instruction. 
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Abstract. The purpose of this presentation is to show how instructional technology 
can be exploited to effectively integrate Common European Framework of Reference 
(CEFR) ‘Can Do’ performance objectives (Council of Europe, 2001) into the syllabus 
and assessment of an advanced (B2) level course. The particular course that will be used 
for purposes of demonstration is English for Rehabilitation, an English for Specific 
Academic Purposes (ESAP) course offered at the Cyprus University of Technology. It 
is a two-semester compulsory subject for first-year students majoring in Rehabilitation 
Sciences, a Health Faculty discipline. The ultimate goal of the course is to increase 
students’ linguistic competence to allow them to function professionally in English 
as independent learners in all four skills: listening, reading, speaking and writing. 
It will be shown how Internet resources, in particular YouTube and various Google 
applications (Google Drive, Google Docs, Google Scholar, Google Slides, Hangouts) 
are used to provide and organise online content as well as to support students in the 
production of written and oral materials based on discipline-specific input. 

Keywords: instructional technology, CEFR descriptors, English for specific 
academic purposes. 


1. introduction 

The CEFR for Languages (Council of Europe, 2001) provides illustrative scales of 
‘Can Do’ statements, describing foreign language proficiency at six levels, which 
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enable the comparability of tests and examinations across languages and national 
boundaries and the recognition of language qualifications. Instructional technology 
can facilitate the attainment of ‘Can Do’ skills in many ways by providing learners 
with an abundance of resources for both practising and producing the target language. 
Moreover, in Languages for Specific Academic Purposes courses, technology adds 
to the ‘specific’ and ‘academic’ components since it helps to develop complementary 
skills like online library searching, retrieving and evaluating academic and other 
material on the Internet, preparing assignments and presentations using digital tools, 
etc. Although the linguistic part of any language course can be readily aligned to the 
CEFR ‘Can Do’ statements, no such descriptors exist for related specific academic 
skills or the use of technology. It is, thus, the intent of this paper to help close this 
gap by demonstrating, within the context of an ESAP course, how instructional 
technology can be exploited to adapt the CEFR descriptors for B2-level competence 
to the teaching of both linguistic and specific academic skills. 


2. Method 

The particular course that was used for purposes of demonstration is English 
for Rehabilitation, an ESAP at the Cyprus University of Technology. It is a two- 
semester compulsory subject for first-year students majoring in Rehabilitation 
Sciences, a Health Faculty discipline. The ultimate goal of the course is to increase 
students’ linguistic competence to allow them to function professionally in English 
as independent learners in all four skills: listening, reading, speaking and writing at 
an advanced (B2) level. The course was implemented in collaboration with faculty 
members of the Department of Rehabilitation Sciences. Subject area content 
derives from an introductory course, simultaneously taught by this faculty in the 
LI (Greek). Parts of this course were restructured to focus on the interactive use 
of related L2 English vocabulary and grammatical structures. Language instructors 
organised each semester of the ESAP course into four thematic blocks, each lasting 
three to four weeks. 

At the beginning of each thematic block, a member of the academic staff from the 
Rehabilitation Sciences department gave a short lecture (30-45 minutes) in English 
on the block’s topic. The lecture was audio-recorded in Hangouts on Air and stored 
in the language instructors’ YouTube channel and made available to students. Over 
the following weeks, students undertook various tasks based on the content theme. 
These all involved realisations of specific B2-level ‘Can Do’ descriptors such as 
‘Listening as a member of a live audience’, ‘Note-taking (lectures, seminars)’, 
‘Processing Text’, and ‘Sustained Monologue’. 
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Once the learning objectives were set, the technology tools to be used were 
chosen and it was decided how these were to be used in order to achieve the 
desired outcomes. Internet resources, in particular YouTube and various Google 
applications (Google Drive, Google Docs, Google Scholar, Google Slides, 
Hangouts) were used to provide and organise online content, as well as to support 
students in the production of written and oral materials based on discipline-specific 
input. These included listening to lectures in their field of study, taking notes and 
collaboratively synthesising these in written course summaries. Individual note¬ 
taking and paraphrasing of assigned disciplinary readings were also undertaken 
based on printed as well as web-based sources. Students were taught to take 
responsibility for their professional learning in English through collaborative 
web-based research on topics related to their discipline, for which they produced 
essay outlines. Communicative use of the language was practised through regular 
small-group interactions in class as well as through the preparation and delivery 
of professionally-related oral presentations using various PowerPoint functions 
and Prezi. Finally, students also had to provide their reflections at the end of each 
thematic block, which aimed to make them aware of their own learning processes 
and thus more independent. 

Course assessment, both formative and summative, was determined in relation 
to students’ ‘Can Do’ linguistic performance. The course grade was based, for 
both individual and group assignments, upon the extent to which students’ lecture 
summaries, reading synopses, research outlines and oral presentations corresponded 
to the CEFR B2-level ‘Can Do’ descriptors for reading, writing, listening and 
speaking. As a capstone project, students produced a Google Doc-based individual 
e-portfolio in which they summarised the activities carried out during the course 
and, more generally, reflected upon their learning. The final exam, although in 
paper form, assessed students against the same ‘Can Do’ descriptors, i.e. reading a 
profession-related text, taking notes on it, paraphrasing some parts, summarising 
the whole text and showing awareness of the vocabulary learnt. 


3. Results 

At the beginning of the first semester course, students were overwhelmed by the 
fact that they had to deal with discipline-specific material in English. Within a 
few weeks, however, as the lecture topics became more professionally targeted, 
they were not only more interested in the content, but also more engaged in 
the use of the language, working on summarising, synthesising, taking notes, 
vocabulary and language activities in English. The recurring pattern of activities 
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in each thematic block helped students become more at ease with the assigned 
tasks, which they often undertook without being told. 

As with the specific academic skills aspect of the course, the use of technology 
tools initially proved very daunting for students, most especially Google Drive. 
However, the support provided to students, and their own experimentation, 
allowed them to quickly overcome their apprehensions. After the first two 
thematic blocks in the first semester, students were comfortable using the various 
technologies and even tried out new ones (e.g. Prezi, PowerPoint) on their own. 
Most use of technology took place outside of class, with one student who was 
abroad at the time even using Skype to contribute to a group presentation in 
class. Above all, students had easy access to online materials and could carry 
out their activities via tools such as Google drive and Google docs, which were 
automatically saved and accessible from virtually anywhere. Ubiquitous online 
access to shared documents also fostered the undertaking of collaborative tasks, 
allowing students to easily work together to improve their English and co¬ 
construct disciplinary knowledge. 


4. Conclusions 

Overall, it can be said that technology, especially Google applications, played a 
vital role in realising the ‘Can Do’ objectives of the English for Rehabilitation 
course. The course Google Drive allowed instructors to store and distribute course 
materials in digital form as well as link to a multitude of online resources. With 
Google Docs, students had access to their own work online at any time. So, too, 
the online collaborative work that the Google Drive and Google Docs made 
possible constituted a motivational factor for all group members in the completion 
of activities, as well as a means for improving linguistically, especially for lower 
level students. Finally, Google docs provided the platform for the e-portfolios in 
which students synthesised all work (assessed and non-assessed) carried out in 
each semester, constituting in effect each student’s self-generated online textbook 
for the course. 
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Abstract. This article describes the use of instructional technology to promote, 
through a combination of behaviorist/structuralist and communicative/action- 
based methodologies, correct pronunciation of French as a Foreign Language 
(FFL) to native Greek-speaking false-beginner-level learners. It is based on the 
analysis of a teaching programme, complemented by an end-of-semester student 
evaluation questionnaire. Within the curriculum of the A1/A2 level French courses 
at Cyprus University of Technology (CUT), learners acquire the spoken language 
largely through communicative action-based tasks. In addition, teacher-authored 
preparatory exercises, created using the Schoolshape digital language lab system, 
provide the content of pronunciation exercises. Being cloud-based, Schoolshape 
allows teaching and learning to extend out of the classroom. Students can complete 
exercises virtually anywhere there is a broadband Internet connection and receive 
immediate automatic feedback as well as profit from the asynchronous online 
monitoring of their instructor. Moreover, the pronunciation exercises, whose 
substance is linked to the action-based tasks, can be meaningfully integrated into the 
communicative curriculum. An end-of-year survey collects feedback from students 
concerning the attention paid to their pronunciation in general and their use of 
Schoolshape in particular. 

Keywords: phonetic correction, behaviorist methodologies, structuralist 
methodologies, action-based methodologies, digital language lab. 
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1. Introduction 

In this article we describe the use of instructional technology to promote, 
through a combination of behaviorist/structuralist and communicative/task-based 
methodologies, correct pronunciation of FFL to native Greek-speaking false- 
beginner-level learners. 

Computer-Assisted Language Learning (CALL) has long been valued for its 
potential to extend teaching out of the classroom (Reinders & Darasawang, 
2012), which for oral production is essential given the practical constraints on 
in-class activities. CALL pronunciation programs designed for this purpose are 
numerous 4 . However, in attempting to exploit such online resources, teachers of 
FFL are confronted by two considerable shortcomings. Firstly, the majority of 
these websites are generic in nature and thus do not take account of L 1-specific 
factors (here Cypriot Greek). Secondly, practice exercises are typically undertaken 
in isolation from communicative activities. Overcoming these obstacles requires 
teachers to create materials attuned to the L1 of their learners and integrated into 
the syllabus. In so doing, the ultimate goal is to foster the acquisition of correct 
pronunciation, not just in isolated exercises, but in spontaneous speech linked to 
meaningful discourse (Abou Haidar & Llorca, 2016). The following discussion 
describes how these challenges were addressed in two FFL courses at CUT. 


2. Teaching/learning spoken French 
in A1/A2 level courses at the CUT 

The students involved in our study were enrolled in two courses during the 2016 
Spring semester (Level 1 [CEFR Al] and Level 2 [CEFRA2]). They had studied 
French for four years in secondary school, or more in private institutes. In general, 
their speech was strongly accented to the point of preventing intelligibility, in 
particular at Level 1. The two courses adopt an action-based approach and aim to 
give students the opportunity to express themselves autonomously and authentically 
in situations as close as possible to those of everyday life. Learners acquire the 
spoken language largely through the in-class and out-of-class preparation of 
dialogues they create in making three short video clips which they film using their 
mobile phones. The work is individual and/or collective (in teams of two or three). 
The preparation of these clips includes the acquisition of grammar, vocabulary, 


4. For a general discussion on CALL resources for pronunciation instruction and on their merits and limitations, see Derwing 
and Munro (2015). 
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phraseology, pragmatics and some aspects of pronunciation related to the themes 
of the role-plays (Level 1: getting to know someone, describing my house, giving 
directions; Level 2: at the market, at the restaurant, introducing oneself for an 
internship). From the beginning, students are made aware that pronunciation is 
taken into account in the evaluation of their video clips and in the midterm and 
final exams, which motivates them to take it seriously. There being little time for 
in-depth work on pronunciation in class, the great part of phonetic correction is 
undertaken out of class with Schoolshape. 


3. Using the Schoolshape digital language lab system 

3.1. Presentation of Schoolshape 

Operating entirely from a remote cloud-based server, Schoolshape (www. 
schoolshape.com) is accessible from any broadband Internet connection, which 
facilitates its use both within and outside the classroom. The pronunciation 
exercises developed in Schoolshape are closely linked to the vocabulary, 
grammar and content of task-based role-play activities. Since they are audio 
recorded, the results of these exercises can be monitored by instructors to track 
student progress and more effectively target follow-up correction. The latter is 
done during face-to-face debriefing sessions which follow the evaluation of the 
role-plays. 

3.2. Types of exercises 

Before starting phonetic training exercises, Schoolshape is used to establish a 
general phonological profile of each class and individual profiles for each student. 
This is accomplished by audio recording the pronunciation of key words containing 
known difficulties (e.g. front rounded vowels, nasal vowels, voiced-voiceless 
plosives) 5 . The purpose of these profiles is to provide more precise, better-targeted 
and more effective remedial work. Thanks to the flexibility of its management 
system, Schoolshape can be used to assign exercises to a class, as well as to 
individuals so they can work specifically on their own problems. 

Aural discrimination exercises are exploited to make same/different judgements 
and to identify which particular sounds are heard (Figure 1). 


5. These key words are taken from the Interphonologie du Frantpais Contemporain corpus list (http://cblle.tufs.ac.jp/ipfc/) 
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Figure 1. Aural discrimination exercises 



As learners gain competence in discriminating between the sounds of the LI and 
the L2 as well as between L2 sounds, they also begin to notice the gap (Schmidt, 
2010) between their own pronunciation and that of normative models. Listen/ 
repeat exercises are used to provide pronunciation practice with words and short 
phrases containing targeted phonological features. Written language is exploited to 
provide visual support for oral output and establish phonological correspondences 
with the orthographic system (note the underlined consonants in Figure 1). 

The reading out loud and recording of model words and phrases provides both 
pronunciation practice and preparation for task-based role-plays (Figure 2). 
This is followed up with interactive communicative exercises: virtual simulated 
dialogues without written support in which students record their responses to 
oral prompts. 

Figure 2. Model words and phrases 
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Schoolshape exercises are specifically designed to target the pronunciation 
difficulties of Cypriot learners (e.g. the absence of phonemic distinction between 
voiceless and voiced plosives - See Figure 1). Cognate French-English vocabulary 
also receives special attention to redress the strong contaminating effect of the L2 
English pronunciation of words with similar or identical spelling in both languages 
(e.g. commerce, finance, Internet). For all exercises, the recording of students’ 
productions allows the instructor to asynchronously monitor learners’ progress and 
is the basis for the face-to-face sessions. 


4. Students’ evaluation of the Schoolshape program 

All students (36) answered an end-of-semester evaluation questionnaire 
concerning the pronunciation teaching method used in the courses and the 
improvement of their pronunciation. As is attested in the following results, 
overall student reaction to the Schoolshape program was very positive. Over 93% 
of students felt that the exercises improved their pronunciation, 50% appreciably 
and 44.4% a lot (Figure 3). 


Figure 3. Schoolshape : improved pronunciation 


60 


The online exercises helped you to improve your 
pronunciation 



a lot appreciably a little 


Since the purpose of the Schoolshape exercises was to improve the students’ 
phonetic accuracy and speaking skills by focusing on the pronunciation of words or 
phrases that they would need for the creation of their filmed dialogues/presentations, 
they were asked about the impact of these exercises on the creation of their videos. 
Here again, the great majority (83%) indicated that Schoolshape had helped a 
lot (44.4%) or appreciably (38.8%) (Figure 4). The instructors observed that the 
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Schoolshape simulated dialogues in particular had provided effective training. The 
set phrases relevant to specific role-play situations that had been practiced with 
Schoolshape were internalized by students and enunciated more confidently, with 
phonetic features (segmental and suprasegmental) that rendered them intelligible. 

Figure 4. Schoolshape : video creation 
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Lastly, when students were asked to indicate in what way(s) Schoolshape helped 
them to improve their pronunciation, the most frequent responses were that the 
exercises allowed them to listen to and repeat words/sentences (36.1%) and to 
become aware of what the correct pronunciation was (30.5%). A quantitative 
analysis of the progress made by students in their production of specific 
segmental phonetic features was done at the end of the semester for the Level 1 
students (22). The features were: the vowels /y/ and /u/, the voiceless plosive /t/ 
in etudiant and the silent final consonant in etudianX. The students’ productions 
in the initial profiles were compared to their reading aloud of short sentences 
during the final oral exam. Correct pronunciations improved from 15% to 54% 
for /y/; from 25% to 77% for /u/; from 5% to 73% for /t/. 68% of students did 
not pronounce the final <t> while the majority did at the beginning of the course. 


5. Conclusion 

Though out of fashion, behaviorist/structuralist focus-on-form exercises (for 
perception and production) nonetheless remain a methodologically valid 
approach to L2 pronunciation training. Thanks to the cloud-based instructional 
technology of the type provided by Schoolshape, it is now possible to exploit 
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structuralist concepts such as contrastive analysis and phonemic opposition in 
remedial exercises that can be undertaken anywhere a student has access to an 
Internet connection. Freed from the normal constraints of classroom time, the 
acquisition of correct pronunciation can be integrated into a communicative/ 
action-based curriculum in a way that is motivating for students. Above all, our 
experience to date shows that there was substantial progress in the students’ 
pronunciation of the phonetic features targeted during the semester. 
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Abstract. Learning has been moving out of classrooms into virtual and physical 
spaces for over a decade now (Naismith, Lonsdale, Vavoula, & Sharpies, 2004). 
It is becoming mobile ‘in space’, i.e. carried across various domains (workplace, 
home, places of leisure), ‘in time’, as it encompasses different moments of the day, 
and in terms of ‘learning purpose’, which may be related to work, self-improvement 
or leisure (Vavoula & Sharpies, 2002). In line with the principles of learning in an 
informal, incidental and mobile way, an open source and geolocalised application 
for learning foreign languages with a smartphone is being implemented within 
Key Action 2 of the Erasmus Plus European framework by the project called 
ILOCALAPP - Incidentally Learning Other Cultures and Languages - (Ceccherelli 
et al., 2016). ILOCALAPP will result in an app to aid in learning Finnish, Italian, 
Polish and Portuguese embedded within their respective cultural practices. The 
target group is mobility students, so the app will be situated in the university city 
where international students arrive, i.e. the Finnish language content will unfold 
in Rovaniemi, Italian in Bologna, Polish in Poznan, and Portuguese in Coimbra. 
The learning content will blend in the students’ everyday contexts, whereby the app 
would be used incidentally in a game-like manner, thus providing enjoyable learning 
moments throughout their daily activities in an informal way. 

Keywords: MALL, incidental learning, geolocalisation, multilingualism, less 
commonly taught languages. 
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1. introduction 

Measures on the promotion of lesser used languages in Europe have been 
established by the European Commission since the late 1980s. Languages spoken 
in the countries of 1LOCALAPP partners fall within the multilingualism policies 
on Less Widely Used and Taught Languages in Europe (European Commission, 
2011). The acknowledgement of the importance of informal learning in lifelong 
education within the EU, as well as the implementation of common policies for 
mobility by Erasmus Plus programme provide common political guidelines for the 
1LOCALAPP project. 

Online and mobile technologies have opened up exciting new possibilities 
for study in higher education. Mobile learning can make boundaries between 
educational settings, life and work more permeable. Our app will build on 
mobile devices while exploiting their built-in sensors (e.g. GPS, gyroscope, 
accelerometer, camera), as well as an Internet connection, thus enabling to 
detect and identify user activities and trigger some contextual contents and 
activities related to specific geolocalised Points of Interest (POIs). As the user 
gets close to a POI, the app will upload relevant contents and activities (e.g. 
ordering food in a cafe, asking for directions). With the app, learning languages 
becomes more accessible in various situations, collaborative and participatory. 
By foregrounding cultural values and practices, it provides opportunities for 
authenticity, communicativeness and inclusion. 


2. Mobile technologies and learning of languages 
and cultures: some theoretical underpinnings 

We start off from the theories of situated and incidental learning where all 
learning is embedded in the learners’ social, cultural and historical contexts, 
representing interaction with their lifeworlds (Lave & Wenger, 1991). Integral 
to this process becomes participation in a community that shares certain 
cultural values, assumptions and rules, i.e. a community of practice. So in an 
app that supports mobility, the cultural identities of the student and surrounding 
community become especially important. Cultures and languages are viewed 
as mutually dependent - as parts of the complex language-culture nexus which 
is historically and ideologically situated (Risager, 2006). The app serves as an 
interactive device that mediates and sustains the process of discovering new 
cultures and languages, while learners get engaged in open and fluid social 
relations (Lankshear & Knobel, 2006). 
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The need of combining mobile technologies with language/culture learning 
led to creating an interdisciplinary methodological framework at the interface 
between multimedia design, digital literacy and language teaching/learning. The 
resulting framework is oriented around three interrelated thematic clusters: (1) 
collaborative and participatory, (2) integrated and situated, and (3) informal and 
incidental. 

By developing a collaborative and participatory app, the ILOCALAPP team 
aimed to ensure an effective learner participation throughout all stages of the 
app development, from outlining its contents to the use and dissemination. 
Channels for user collaboration and participation were opened through active 
consultation (by carrying out surveys and focus groups with mobility students) 
and participant observation of users while being engaged with the preliminary 
app contents (through experience prototyping). The learning, use of the app 
and the content development are thus co-constructive (Castillo & Ayala, 2012; 
Traxler & Kukulska-Hulme, 2016). 

The app will also be integrated and situated, so that its content is based on authentic 
and real-life situations, while the learning is context-aware. The context for 
ILOCALAPP is the daily student life in one of the partner university cities - well 
within the overall trend for mobile learning, which had evolved from learning with 
computers to being part of the ubiquitous use of mobile devices (through POIs and 
geolocalisation). 

Finally, the app will be informal and incidental: both the contexts, contents and use 
of the app are situated outside the classroom and within the everyday activities of 
a mobility student (Laurillard, 2007; Silva, 2007). Units and exercises of formal 
learning are replaced by POIs, a flow of activities and game-like elements in the 
app contents. 


3. From theory to the content design 

Factors of diverse nature contribute to the efficacy of foreign language acquisition, 
from internal factors such as aptitude, age, cognitive styles, motivations, etc., 
to external ones, like sociocultural features of the contexts learners live in. The 
richness and variety of the linguistic input, as well as the significance of the 
communicative situation learners experience, play a crucial role in the process of 
spontaneous acquisition. To ensure its exploitability and usability, the input should 
be comprehensible (Krashen, 1985), so access to written and oral texts is essential 
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before interaction. Mapped onto the core values (collaborative/participatory, 
integrated/situated, and informal/incidental), the linguistic acquisition principles 
have guided the 1LOCALAPP team in the conception of authentic contents for 
each town, in order to provide useful materials for students’ daily life actions and 
interactions for language learning. 

Contents will be accessible through three different points of entry: ‘In the place’, 
‘Activities’, and ‘Culture’. The entry ‘In the place’ comprises nine categories 
as informed by the lived experiences of an Erasmus student in a new town: (1) 
Uni Life, (2) Getting around, (3) Food & Drink, (4) Sights, (5) Entertainment, 
(6) Lifestyle, (7) Services, (8) Shopping, and (9) Me in... Each category includes 
sub-categories; for example, in ‘Sights’, users can explore POIs linked to the most 
relevant ‘squares’, ‘monuments’, and ‘parks’ in town, etc. 

Me in... seems to be the most innovative category: an open space where users 
can personalise the app content by bookmarking their favourite linguistic and 
communicative resources. It provides the app users with a space to negotiate their 
own cultural identities and practices as well as find affinities with other users, thus 
building a community of practice. 

Geolocalisation will also facilitate the content exploration thanks to active 
notifications about the different POIs. App users are expected to be inquiring 
cultural and historical information about the place, but are also encouraged to 
interact with other speakers in it. For this reason, the section ‘Tips for talking’ 
consists of suggestions of words and expressions useful and coherent with the local 
communicative situation. Simultaneously, the section ‘Talk’ will provide ready¬ 
made sentences in a written/audio format, followed by prototypical answers. 

A robust effort has been made to let typical situations of the Erasmus students inform 
the app content and also to foresee their potential difficulties in understanding 
written and oral content, considering the following challenges: 

• the app is not strictly addressed to users of a certain level of proficiency, so 
readjustment will be needed to ensure the materials’ authenticity; 

• a valid interlinguistic and intercultural model will not be easy to 
achieve: mobility students learning Italian and Portuguese may count 
on intercomprehension and positive transfer, whereas most mobility 
students in Poznan and Rovaniemi are beginners in Polish and Finnish, so 
comprehension can constitute a major challenge. 
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4. Final considerations and conclusion 

One of the main challenges for the 1LOCALAPP team resides in the fact that the 
app will be launched in 2018, thus needing a considerable foresight to produce 
an app that would still be appealing and relevant to the students’ social, cultural 
and historical realities in 2018 and beyond. From a technical perspective, it is 
a multiplatform web app, designed according to human-computer interaction 
methodologies and built in standard technologies such as HTML5, CSS3 and 
standard scripting languages. Active ongoing contact with mobility students as 
well as their collaboration throughout all stages of the app development will be 
necessary to keep abreast of their lifestyle and potential changes under way. Mobile 
devices are ubiquitous and coidd be assumed to be present in everyday lives of 
mobility students in the future. Most importantly, the next generation of mobile 
learning is becoming increasingly ‘context-aware’ (Traxler & Kukulska-Hulme, 
2016). So ideally, students would see our app as part of their everyday lives to 
provide a pleasant moment of informal and incidental learning amidst their mundane 
and institutional activities. Apart from enhancing student mobility experience, the 
1LOCALAPP team wants the app to pave the way both for spontaneous, motivating 
and context-aware language learning as well as for cultural awareness. 
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Abstract. Heritage language education is distinct from the field of second 
language acquisition due to having the concept of identity always at its core 
(Leeman, Rabin, & Roman-Mendoza, 2012). This paper draws on this concept and 
presents an action research study focusing on the teaching and learning of Greek 
as a heritage language in the context of Supplementary Education in the UK. The 
main aim of the study is to support young learners in gaining an understanding of 
how language is intertwined with social and cultural aspects. The study took place 
in two Greek Supplementary Schools in UK during the academic year 2015-16. 
The participants are learners of Greek language attending pre-GCSE, GCSE and 
A’Level classes (13-17 years old). For the purposes of this study, the learners used 
mobile and web-based technologies, i.e. nQuire-It platform (http://www.nquire-it. 
org), to explore their environment through specific missions. The study involved 
a number of classroom sessions, attendance of an inter-generational object¬ 
handling workshop run by educators based at the British Museum at each of the 
two schools, and also participation in a museum visit. The paper presents this 
study and shares some preliminary findings and insights regarding the integration 
of mobile technologies within heritage language learning and teaching. 
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mobile technologies, young people. 
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1. Introduction 

At the outset of this paper is a recognition of the fundamental relationship between 
language and culture and an acknowledgment that this relationship is central to 
any process of learning another language. Especially in the context of heritage 
language education where the concept of identity is at its core (Leeman et ah, 2012), 
and young learners are seen as having an emotional connection to the culture and 
language of the country of origin, such ideas cannot simply be seen as a body of 
knowledge to be taught. Rather, it is important to view learners’ "lived experience” 
(Anderson & Chung, 2012, p. 262) of the culture and language as a framework in 
which learners live their lives and communicate shared meanings with each other 
in their communities. In other words, we draw on a view of language as a social 
practice (see e.g. Kramsch, 1998), hence our intention in this paper is to move 
beyond a view of language simply related to acquiring grammar and vocabulary. 
Instead, our view of language “requires learners to engage in tasks in which they 
create and interpret meaning, and in which they communicate their own personal 
meanings and develop personal connections with the new language and culture” 
(Scarino & Liddicoat, 2009, p. 17). 

The paper presents a small exploratory study undertaken by practitioners that draws 
on a blended approach to learning and utilises methods of inquiry learning (e.g. 
observation, data collection, reflection) and mobile technologies to facilitate young 
people’s engagement in their learning. It largely builds upon formal instruction 
in the language classroom and “draws attention to a learning design that blends 
the physical and the digital contexts [as the study] locates itself within a body of 
research seeking to identify more clearly a pedagogical approach to the use of 
technology in a learning setting” (Charitonos & Charalampidi ,2015, p. 198). 


2. Context 


2.1. Supplementary education 

As discussed by Charitonos and Charalampidi (2015), community languages in the 
UK “are typically taught in supplementary/complementary schools. These schools 
offer educational support (language, core curriculum, faith and culture) and 
other out-of-school activities to children attending mainstream schools (Evans & 
Gillan-Thomas, 2015) [and] operate in community centres, youth clubs, religious 
institutions and mainstream schools” (p. 199). 
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2.2. Participants 

The participants are learners of Greek Language attending pre-GCSE, GCSE 
and A’Level classes (13-17 years old) in two Greek Supplementary Schools in 
Buckinghamshire (N=ll) and Leicestershire (N=10). The participants were 
attending language lessons once a week for an average of three hours in total. 

2.3. nQuire-lt platform 


The project takes place on the online Citizen Inquiry platform nQuire-lt (http:// 
www.nquire-it.org), which has been designed as part of the project nQuire: Young 
Citizen Inquiry, coordinated by the Open University in UK. The aim of the platform 
is to assist citizens in conducting their own science investigations, enhancing the 
social investigation aspect and promoting scientific thinking and exploration of the 
world. Two types of missions that are available in the nQuire-it platform were used 
in the study: (1) Spot-it missions, a user uploads pictures for the data collection and 
(2) Win-it missions, a user responds to a question which requires text as an answer. 
For the purposes of this study, and thanks to funding received, the platform was 
translated in Greek (see Figure 1). 


Figure 1. Screenshot of the nQuire-lt platform in Greek 
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nQuire-it Missions 
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fbaaou, Kouta, 
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2.4. Activities 

The study consisted of a number of designed lessons involving face-to-face and 
online activities with specific goals that spanned over several sessions. Whole- 
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class sessions in the classroom focused on selected aspects of the curriculum (e.g. 
vocabulary, i.e. nouns, connectives, adjectives; speaking, i.e. talk about routines 
and habits, describing objects). Additionally, the study sought to provide young 
learners with access to cultural experiences, hence it involved an intergenerational 
object-handling workshop run by educators based at the British Museum at 
each of the two participating schools around the theme of ‘Object Journeys’, 
and participation in a visit to the British Museum around the theme of ‘People’s 
Journeys’ (Figure 2). Whereas the museum educators ran the activities in English, 
the participants were given the option to select any of the two languages in the 
tasks assigned to them and associated interactions. To ensure that all felt included, 
translation in both languages was provided by the teachers. 


Figure 2. Activities in the classroom 



The online missions that have been created on the nQuire-It platform involved 
questions related to the learners’ everyday life (e.g. ‘ItsAHabit’) or their material 
environment heritage (e.g. ‘Looking for #AllThingsGreek’, ‘My very own 
museum’). These initial missions were initiated by the two teachers, with an aim to 
engage learners with aspects of inquiry learning (e.g. observation, data collection, 
reflection). Students were asked to use only Greek on the online platform. An 
example of a mission is described in the following section. 


3. Example: mission ‘Looking for #AIIThingsGreek’ 

The Spot-lt mission ‘Looking for #AllThingsGreek’ involved participants exploring 
their environment and taking photographs of objects that could be associated with, 
or remind them of Cyprus or Greece. 17 users joined this mission on the nQuire-lt 
platform and 18 photos were uploaded (Figure 3). The members of this mission 
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could make comments and like other contributions and had the opportunity to win 
the prize for the best photograph. 


Figure 3. Mission on the nQuire-It platform: ‘Looking for #AllThingsGreek’ 


Apxuat oeW6o Xiijpoi auOitnorit; XxetiKd Anwioupvtu AiaxEipiorfa | Ava&ixcb anooToXfc... □ EAAqviKd (el) i 
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Tags: Greek schools 


TcAEuraia qxutoypaqiia 



□ □ © 


Mission discussion 


rivopai utAoc at aua) t qv anooioXq yta 
vamoudnnou. 


Each mission involved preparatory and follow-up activities in the classroom. For 
example, prior to the mission ‘Looking for #AllThingsGreek’, students explored 
their school to spot objects that could be linked to Cyprus or Greece and provided 
descriptions and explanations in Greek related to their choice of particular 
objects. A follow-up activity took place in the classroom, where students had the 
opportunity to examine the whole data set of the photos uploaded on the platform, 
and, through group interactions and facilitated discussion with the teacher, to 
engage with observations, analysis and reflection. This activity is described in 
detail in a forthcoming publication (see Charitonos, forthcoming). 

Preliminary findings from this mission point to students being engaged in this 
task, describing the objects and communicating their meanings around the objects 
that could be found in their own environments, such as souvenirs, faith items, 
crafts, and everyday objects. Students were able to make the connection between 
the physical and the digital contexts, though not all uploaded their photos online. 
Another finding is that students’ own experiences with technology determined 
their engagement with the platform. For example, participants were asking for an 
app to directly upload pictures on the nQuire-It platform. In addition to this, it 
became apparent through their discussions with their teachers that a few shared 
some feelings of anxiety in creating and posting comments in Greek online. Issues 
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of anxiety related to performance in the language-in-focus might have been a 
barrier in students’ participation. Finally, schools’ infrastructures (i.e. no internet 
connection) are seen as a limitation in students’ participation in the study. 


4. Conclusions 

The paper presented a small exploratory study that follows a learner-centred 
pedagogical approach in examining the integration of mobile and web-technologies 
in the language classroom in a way that allows young learners to engage in the 
social and cultural contexts they are embedded in. By blending the physical and 
the digital domains, and structuring students’ engagement in and through missions, 
students could gather evidence, and offer descriptions and interpretations. The 
initial missions were initiated by the two teachers, but future plans include 
providing a general topic (e.g. Discovering your High Street) and giving control 
over the missions, the design, and how to carry out the investigation to the students. 
Future investigations could also draw on concepts (e.g. tradition) that emerge from 
data generated by students to generate new missions that will serve to challenge 
students’ established ideas (e.g. What is tradition?). 
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Abstract. The recent technological developments and widespread use of mobile 
technologies challenge traditional knowledge and skills, with language learning 
increasingly taking place beyond the language classroom in learners’ own 
environments. The paper presents the ImparApp study that focuses on a pervasive 
and gamified approach to language teaching and learning. The study investigated 
language learning with mobile devices as an approach to augmenting language 
learning by taking learning outside the classroom into the real-world context. The 
paper reports on the design, development and testing of an introductory Italian 
Language Learning game, i.e. ImparApp, that is developed with the use of MIT’s 
TaleBlazer authoring tool. Preliminary findings of the pre-pilot of the game prototype 
are drawing on data collected through participant observation of a play-test session 
followed by a focus group interview. The paper contributes to the field of mobile- 
assisted language learning with insights on pervasive and gamified approaches to 
teaching and learning a foreign language. 

Keywords: mobile-assisted language learning, MALL, pervasive learning, game- 
based learning, higher education, Italian. 


1. Introduction 

Recent developments in mobile and web technologies bring great potential for 
innovation in teaching and learning, and inevitably influence language learning, 
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arguing for the need to rethink practices. The paper presents a pervasive and 
gamified approach to teaching and learning Italian in a university context with an 
aim of engaging students towards a more enhanced learning experience. The study 
blends activities traditionally taking place in the classroom with activities enabled by 
the technology and draw inspiration on the built environment of a city, and utilises 
opportunities offered by location-based services that allow for narratives/activities to 
evolve via a learner’s location. The paper examines this approach by outlining the 
development of ImparApp - a prototype mobile game for learners of Italian language. 


2. Context 


2.1. Language learning at Coventry University 

Students at Coventry University can learn a foreign language by attending an 
Add+vantage module. These modules are credit bearing and aim to develop 
students’ employability skills. The participants were attending an Italian Language 
Add+vantage module. 

2.2. ImparApp mobile game app 


The ImparApp prototype game was developed with Tale Blazer, which is an open- 
source authoring tool, developed by MIT, for pervasive gaming to allow users to 
develop location-based augmented reality games (see Figure 1). 


Figure 1. Screenshots of the ImparApp prototype game (Part 1) 
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Introduction 

This year, researchers at 
Coventry university have made 
a ground breaking discovery in 
science that will benefit the 
entire planet: A Time machine! 

Although the researchers were 
striving to use time travel for 
the greater good, it seems one 
of them had other ideas. 
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The ImparApp game engages learners in a range of experiences and interactions 
as they move around their real physical location seeking to solve a time travel 
mystery. Specific tasks are triggered by learners’ Global Positioning System 
(GPS) coordinates, which prompt the users to explore the city of Coventry by 
providing information about its history and heritage. The tasks focus on the four 
language skills of listening, speaking, reading and writing. Importantly, the app 
allows the learners and tutors to monitor progress via a leaderboard. The design 
of the app and game mechanics are discussed in detail in Morini et al. (in press), 
where it is noted that a key aspect of the design approach is that it allows its users 
to experience their everyday living contexts and their course’s content in a new 
and playful way. 

2.3. Content and learning objectives 

The ImparApp is designed to be used in a blended mode: learners spend one week 
in the classroom with a tutor, and the following week completing challenges and 
tasks with the app in a self-guided mode. Through the targeted use of this app in 
a beginners’ module a student will have opportunities to practice speaking and 
writing short passages using appropriate grammatical structures for the task and the 
level. Further to this, a student should be in a position to recognise information and 
understand short texts with simple familiar words and phrases about themselves, 
their family, and concrete situations they know well. 

In its current form, the ImparApp prototype game consists of four parts. Text in 
Part 1 is in English (see Figure 1) while Part 2 makes use of English and includes 
translation in Italian in brackets. Part 3 is in Italian and includes translation in 
English in brackets and finally Part 4 is in Italian. The four parts cover the following 
topics: yourself and others; work and family; routines, free time, leisure activities; 
and food and drinks. The app also embeds content that aims at raising students’ 
awareness of the Italian culture. 


3. Method 

The development of the ImparApp aims to investigate the crossings of game- 
based learning and pervasive learning in support of language teaching and 
learning and, further, to empirically evaluate the consistency of a holistic and 
modular design model as a tool to guide the design process, as suggested by 
Arnab et al. (2015) (see Figure 2). 
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Figure 2. Holistic and modular approach (Arnab et al., 2015, p. 454) 


Layer 4: 
Technology 

Interfaces 

Media 

Analytics 

Communication 

Content 

Layer 3: 
Game design 

Mechanics 


Narratives 


Aesthetic 


UX/EX 

Layer 2: 
Context of 
learning 

Mode 


Loca 

ion 

Ac 

tivities 

t 

Assessment 

Layer 1: 
Learning 
needs 

Learners 

Lesson 

path 

Pedagogy 

Learning 

objectives 

Measures 


Drawing on this model, the research team designed a pre-pilot play-test session to 
inform the development of the ImparApp prototype. This pre-pilot study took place 
in the Spring semester of 2016. 

The pre-pilot play-test session involved testing Part 1 of the game. The participants 
were seven students (N=7) attending a Lower Intermediate Level Italian Language 
module at Coventry University (Common European Framework of Reference 
for languages Level A2). The students were selected as their knowledge of the 
Italian language was seen as allowing them to focus on usability and engagement 
aspects of the game (Layer 2/Layer 3 in Figure 2). Members of the research team 
accompanied the students, who were split in three groups (Figure 3). 


Figure 3. Play-test session in the city of Coventry 
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Data was collected through a number of open-ended questions posed to the 
participants at the beginning (e.g. Why did you accept taking part in this testing?; 
How competent do you feel in Italian/in using tech/in games?) and at the end of the 
play-test session (e.g. What would you change?; How do you see language learning 
‘working’ within this app?); participant observation was conducted using a semi- 
structured observation sheet and a focus group interview that took place right after 
the session involving participants, tutors and researchers. 


4. Findings and discussion 

All students appeared positive regarding the use of the ImparApp for language 
learning. The following comment by one participant is indicative: “I haven’t seen 
this before. Usually is only dictionaries, translations... This is more interactive 
instead of sitting on a desk/with a book”. One observation made by the research 
team during the play-test session was that the participants had limited interactions 
in the language-in-focus. This is seen as being largely associated with the design of 
Part 1 (i.e. introduction of the game, learning Italian phonetics and pronunciation), 
hence tests of Part 2 to Part 4 are currently planned with an aim to examine this 
observation further (Layer 2 - Activities, Figure 2). Additionally, most interactions 
in the groups were related to finding their orientation, an aspect that is seen 
associated with their game experience (Layer 3 - Mechanics, Figure 2). Future 
iterations will allow for more interactions among the users (Layer 1 - Pedagogy, 
Layer 2 - Activities, Figure 2), and with their built environment. Indications of 
incidental, non-language related learning, also emerged in the data (Layer 1 - In/ 
non/formal, Figure 2). For example, a participant referred to a historic pub in 
Coventry: “Whitefriars Pub... I didn’t know anything about the pub and the little 
alley behind the cathedral”. 

Furthermore in the focus group interview, students made a few suggestions (e.g. 
audio, video in Italian; Italian music; zoom map), which informed the development 
of the four parts of the app (also see Morini et ah, in press) (Layer 2 - Mode, 
Figure 2). During the development process the team also responded to students’ 
comments regarding the use of English and Italian, hence the language-in-focus 
is gradually introduced in the game’s descriptions and instructions (see section 
Content and learning objectives). 

Finally, issues of assessment were raised in the focus group interview (Layer 2, 
Figure 2). Students shared some concerns and expressed a preference for traditional 
methods of assessment. For example a participant said “you can go off the app and 


98 




Urban explorations for language learning... 


do the assessment... checking answers on a laptop. So, still you [teachers] need to 
do assessment in the class”. 


5. Conclusions 

The paper described a pre-pilot study focusing on new possibilities that emerge 
in language learning and teaching when pervasive approaches to learning are 
combined with game-based techniques. Initial findings show that the ImparApp 
game was positively perceived by a group of students, as it allowed them to 
experience their course’s content in a new and playful way. Limited interactions in 
language-in-focus were observed, whilst indications of incidental, non-language 
related learning were noted. Comments on the mode of communication of the 
content, along with issues related to assessment were raised by the participants. 
Future developments include another pre-pilot blind-test study of the four parts 
of the app (Autumn 2016) to inform the next iteration of the app, and a pilot 
implementation of the ImparApp in the Absolute Beginners Italian Course in the 
university (Winter 2017). To conclude, the study prompts us to rethink the design 
and organisation of a university language course in terms of learner’s experience, 
with an emphasis on context, learner’s movement and interactions of the physical 
and virtual worlds that the learners find themselves in. 
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Communicate to learn, learn to communicate: 
a study of engineering students’ communication 
strategies in a mobile-assisted learning environment 

Li Cheng 1 and Zhihong Lu 2 


Abstract. This paper reports a 3-month study investigating engineering students’ 
Communication Strategies (CSs) in a mobile-assisted course. 67 Chinese learners 
of English in this course volunteered to participate in the study. The instruments 
included oral communication sessions, stimulated recall interviews, WeChat 
exchanges, etc. Results showed that the participants used a variety of CSs when 
completing the academic tasks. Moreover, these CSs were closely related to the 
students’ involvement in meaning negotiation while they were interacting to 
complete learning tasks. It is suggested that instructors have CS training tailored 
to their students’ learning tasks. Future research should focus on a longitudinal 
investigation of the transfer of CSs across tasks. 

Keywords: English education, communication strategies, mobile-assisted language 
learning, academic performance. 

1. Introduction 

The effects of technology in English education have been investigated extensively 
in the past three decades. Researchers have claimed that learners in a class with 
Computer-Assisted Language Learning (CALL) have better opportunities for 
learning than those in the traditional approach of face-to-face instruction (e.g. 
Beatty, 2003). Mobile-learning, for example, has been found effective for second 
language (L2) learning because of the flexibility offered to L2 learners in and 
outside of the classroom (Godwin-Jones, 2011). Drawing on the recent researches 
in mobile-learning (e.g. Huang, 2014; Jamshidnejad, 2011; Jantjies & Joy, 2015), 
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the present study aimed at examining the CS used by Chinese engineering students 
learning English in Mobile-Assisted Language Learning (MALL) settings. 

The notion of CS in L2 education was first raised by Selinker (1972), followed 
by a series of systematic analysis of the definitions and taxonomies of CSs (e.g. 
Domyei & Scott, 1997; Faerch & Kasper, 1983; Tarone, 1977). For the purpose of the 
study, Domyei and Scott’s (1997) definition of CSs was used. According to Domyei 
and Scott (1997), CSs are problem solving devices used to handle three types of 
communication problems: (1) Own-performance problems (e.g. the strategy of ‘self¬ 
repair’), (2) other-performance problems (e.g. the strategy of ‘meaning negotiation’), 
and (3) processing-time pressure (e.g. the use of fillers, hesitation devices, etc). 

Previous researches of CSs have mainly focused on the identification of learners’ 
CSs. Few have been found investigating how Chinese learners use CSs in MALL 
contexts. The following were the research questions in the present study: 

• What CSs do Chinese learners of English use when they are interacting to 
complete academic tasks? 

• To what extent are the CSs used in-class communication sessions similar 
to or different from those used in WeChat interactions? 


2. Method 

2.1. Site and participants 

This study was conducted in a joint program between a Chinese university and a 
university in the UK. The course of Professional Applications (PA) was offered to all 
the Year 2 Chinese students in this program in Beijing. In PA, students were expected 
to do various lands of the tasks/projects including a 12-week project of organizing 
a Modal International Conference (MIC). The teaching contents were arranged with 
two hours’ face-to face instruction every week supplemented by group discussions 
using WeChat on mobiles, one of the most popular social networking tools in China. 

The study covered three months, from March to May of 2016. ‘Organizing a 
Conference’ was the focus of the study. The PA course was taught in English in 
China. 67 students volunteered to participate in this study. Among them, 35 were 
majoring in Telecommunications Engineering with Management and 32 in Internet 
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of Things Engineering. These participants were divided into ten groups of six/ 
seven. They made their own decisions as to which group to join in. 

2.2. Procedures 

Two types of data served as the major sources for analysis of this study: (1) eight 
in-class communication sessions and 10 stimulated recall group interviews, and 
(2) the participants’ WeChat exchanges with their group members while they 
were discussing their coursework. All the data were transcribed and coded by the 
researchers. 


3. Results and discussion 

A total of eight hour communication sessions and five hour interviews were 
analyzed. The WeChat messages consisted of 18,241 words, 192 voice messages 
and 597 emoticons/pictures/videos. Based on Dornyei and Scott’s (1997) Inventory 
of Strategic Language Devices, the researchers analyzed the transcripts in in-class 
communication and identified 16 CSs over 33 CSs (See Table 1). 


Table 1. Description of CS use in the in-class communication sessions 



Category of CS 

Examples of Discourse Markers 

Frequency 

1 

Message 

abandonment 

“MIC? Ur...It’s a meeting?... Okay.” ((With 
a puzzled facial expressions and frowns)) 

336 

2 

Message 

replacement 

((Retrospective comments)) “I’m the char. 

I forgot how to say chengxuce ((conference 
program)). So I had to say something else”. 

245 

3 

Circumlocution 

“Dress code means wearing shirts and suits...like 
this.” ((Shows a picture of two students volunteers 
at Global Mobile Internet Conference 2015)) 

424 

4 

Approximation 

Use of “composition” or “essay” 
instead of “conference paper” 

245 

5 

Use of all¬ 
purpose words 

“the thing”, “something like that” 

198 

6 

Word coinage 

“unsatisfied”, “unlegal” 

88 

7 

Literal 

translation 

“After I entered into this university...” 

398 

8 

Foreignizing 

“That’s all simida” ((Use of the 

Korean word simida for stress)) 

88 

9 

Code-switching 

“G si” and “G wu” ((Chinese 
equivalent for G4 and G5)) 

436 

10 

Repair 

“Ladies and gentlemen. You’re 
wannly welcomed.. .welcome.” 

195 
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11 

Mime 

“Nonverbal communication means... 

((Demonstrates using hand gestures)).. .Is it clear?” 

289 

12 

Use of fillers 

“Well...” 

165 

13 

Repetition 

Speaker 1: “One writing mistake is redundancy.” 
Speaker 2: “Redundancy”? 

Speaker 1: “Yes, redundancy” 

210 

14 

Appeal for help 

“Can you email me the IEEE paper template?” 

321 

15 

Asking for 
clarification 

“What do you mean?” 

254 

16 

Expressing non¬ 
understanding 

“I’m sorry. I don’t understand.” 

132 


Results of the CS use in the in-class communication sessions show high 
occurrences of‘Code-switching’ (F=436), ‘Circumlocution’ (F= 424) and ‘Literal 
Translation’ (F=398). 

The WeChat data showed similar types of CSs used by the participants, except for 
Strategy 11 of ‘Miming/Paralinguistic features’. Because of the absence of face-to- 
face communication in WeChat interactions, the participants tended to use more 
frequently the compensatory strategy of mobile-supported emoticons, voice messages, 
etc. Table 2 shows the frequency of the use of emoticons in WeChat messages. 
Emotions, in this study, refer to graphic representations in instant messaging sessions. 
They may be punctuations, facial expressions, numbers, letters, etc. 


Table 2. Frequency of the use of emoticons in WeChat interactions 



Category of CS 

Explanation and/or Examples from the Data 

Frequency 

8 

Foreignizing 

Use of emoticons for stress/humor. 

Examples: '-S2st , WE?/ (Japanese word ‘nani’ 

meaning ‘what’), eteSSii (Korean words: ‘Ouba’ 
means ‘brother’, and ‘simida’ indicates stress. 

168 

9 

Code-switching 

Use of emoticons which have both 

Chinese and English words. 

Examples: • X , JfflSBSi 

146 

14 

Appeal for help 

Examples: i i (‘What was happening 

just now?’), 

154 
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15 

Asking for 
clarification 

Examples: 

(*) (•) 

16 

Expressing non¬ 
understanding 

Examples: \ 

& 


149 



138 


A closer look at the further contexts of the CSs in the participants’ WeChat 
messages when they communicated to perform learning tasks revealed that they 
used those CSs not only for comprehension purposes but also for interpersonal 
communication purposes. The following extract is a WeChat example: 

1. Jigang: Hi, everyone! We have reviewed all the papers. We’ll soon 
announce the names of the students who will present at MIC. 

2. Lily: Present at MIC? 

3. Jigang: Yes, present at moni guiji huiyi (Model International 
Conference) simida. 

4. Lily: Haosailei! ((The word haosailei means ‘great’ and has the 
pronunciation in Cantonese dialect. It is a popular Internet buzzword in China.)) 

5. Jigang: ((follows Lily’s message and posts a smiley)) (# 176; 2016-04-27) 

In the above situation, the first communicator makes an announcement. The phrase 
of ‘Present at MIC’ is repeated in the second turn, which is a signal for a problem in 
understanding. Jigang interprets this as a request asking for clarification. So in the 
third turn, he rephrases the term using the Chinese equivalent ‘moni guoji huiyi’. 
In the fourth turn, Lily shows understanding and appreciation by using ‘haosailei’. 
In recent years, many foreign cultures and languages have been introduced into 
China. That might explain why some foreign words such as the Korean word 
‘simida’ (expressing stress) and the Japanese word of ‘nani’ (expressing anger and 
curiosity) were frequently used in the participants’ oral communication and in their 
WeChat exchanges. 


4. Conclusions and implications 

In this paper, the researchers have investigated the CS use in mobile-assisted 
learning environments. Three conclusions can be drawn from the above 
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discussion. First, the L2 learners used a variety of CSs in the MALL learning 
settings. Second, the participants used similar types of CSs in in-class 
communication sessions and in WeChat interactions, except for the strategy of 
‘Miming/Paralinguistic features’. Finally, due to the absence of face-to-face 
communication in WeChat interactions, the participants used emoticons more 
frequently in their instant message sessions. The pedagogical implication of the 
study is the reachability of CSs among Chinese learners of English at the tertiary 
level in China. Future research should focus on a longitudinal investigation of the 
transfer of CSs across tasks. 
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for computer assisted second language learning 

Sung-Kwon Choi 1 , Oh-Woog Kwon 2 , Young-Kil Kim 3 , 
and Yunkeun Lee 4 



Abstract. In order to use dialogue systems for computer assisted second-language 
learning systems, one of the difficult issues in such systems is how to construct 
large-scale dialogue knowledge that matches the dialogue modelling of a dialogue 
system. This paper describes how we have accomplished the short-term construction 
of large-scale and machine-readable dialogue maps that match the modelling 
of a dialogue system. The dialogue map is a kind of graph consisting of sub¬ 
tasks, instance-to-slots, and constraints such as ‘necessary’ or ‘optional’. It took 
5.36 months to implement a dialogue modelling in the existing dialogue system. 

Keywords: dialogue map, dialogue system, dialogue system based on dialogue 
maps, computer assisted second language learning. 


1. introduction 


A dialogue system is a computer system able to converse with a human. This 
system has clear potential for Computer-Assisted Language Learning (CALL) that 
places the second-language learner in a practical situation where a specific task 
has to be accomplished in the foreign language. Dialogue systems can be divided 
into two main classes: task-oriented and chat-bot systems. Task-oriented dialogue 
systems provide a framework for users to have conversations with a machine 
to do a task such as reserving a hotel or giving bus schedule information (Raux 
& Eskenazi, 2004; Young, Gasic, Thomson, & Williams, 2013). A state-of-the- 
art of task-oriented dialogue systems is to study a reinforcement learning based 
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on Partially Observable Markov Decision Processes (POMDP) and Deep Neural 
Networks (DNN) that can make speech recognition and the language understanding 
robust (Henderson, Thomson, & Young, 2013; Young et al., 2013). However, task- 
oriented dialogue systems were not successfully deployed on a commercial scale 
because defining the dialogue acts was difficult. A chat-bot system does not aim at 
processing a task-oriented dialogue, but seeks to make a conversation with one or 
more human users. Also, the chat-bot system has the limit of repetitive response to 
the same question. To overcome this issue, a state-of-the-art of chat-bot systems is 
to extract the personal information from user utterances and to apply the personal 
information to a chat-bot conversation (Matter & Wachsmuth, 2014; Kim et al., 
2015). This paper concentrates on the task-oriented dialogue system (hereafter, 
dialogue system) that is closely related with a dialogue-based CALL system. One of 
the difficult issues in these systems is to construct large-scale dialogue knowledge 
such as dialogue scenarios that match the modelling of a dialogue system. The 
existing dialogue modelling had the following weaknesses: 

• Small-scale dialogue scenarios, which were manually made by professional 
educationists for second-language learning study. 

• Difficult dialogue acts, which were defined and constructed by experts of 
dialogue systems. 

This paper describes how we have accomplished the short-term construction of 
large-scale and machine-readable dialogue knowledge that matches the dialogue 
modelling of a dialogue system. 


2. Production problem of dialogue 
knowledge for dialogue systems 

Dialogue systems can talk with users by training knowledge through machine 
learning. The existing methods to build dialogue knowledge for dialogue systems 
can be classified into three parts: (1) extracting dialogue knowledge from real 
dialogue examples (Lee, Lee, & Lee, 2010), (2) building dialogue knowledge from 
logs of dialogue systems (Hong et al., 2009), and (3) manually making dialogue 
knowledge (Choi, Kwon, Jeong, & Kim, 2013). 

An example of computer assisted second language learning using a dialogue system 
is GenieTutor (Kwon, Lee, Kim, & Lee, 2015). It was made with the purpose of 
English learning for Korean people and showed the correction of grammar errors 
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and the overall feedback in fixed dialogue situations. In order to make diverse talk 
with Korean learners, GenieTutor needed large dialogue knowledge operable on 
dialogue systems. Acts were coded in the knowledge of GenieTutor. Dialogue flow 
was constructed by experts who know GenieTutor. It took 5.36 months to choose 
a task and build the whole dialogue knowledge of the task. So we could not help 
building a small quantity of dialogue knowledge. GenieTutor talked with Korean 
learners at a constricted level of dialogue and gave feedback to limited grammar 
error correction. 


3. Construction of dialogue map 
and discussion 

3.1. Position of dialogue map 


Dialogue map is a database in which sub-tasks of a task and dialogue turns of a 
sub-task build a form of graph. Dialogue knowledge automatically extracted from 
the map is used in dialogue understanding and management. Figure 1 shows the 
position of the dialogue map in GenieTutor. 


Figure 1. Position of dialogue map in GenieTutor 



GenieTutor is a kind of hybrid system consisting of a dialogue system and a 
CALL system. Its dialogue system is made up of speech recognition, language 
understanding, dialogue management, language generation, and speech synthesis. 
Its CALL system is located between the language understanding module and the 
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dialogue management module and takes charge of the second language learning. 
The dialogue knowledge of both the language understanding module and the 
dialogue management module are trained from the dialogue map database. The 
dialogue map database could be made by educators who do not know a dialogue 
system. 

3.2. Configuration of dialogue map 

A dialogue map consists of the following: tasks, sub-tasks that constitute a task, 
dialogue materials that compose each sub-task, turns including the materials, and 
paraphrases which are equivalent to a meaning of dialogue turn. A sub-task can 
have his subordinate sub-tasks. Sub-tasks can make diverse dialogue paths through 
constraint operators that decide whether a sub-task is necessary or optional within 
a task and protect reverse order among sub-tasks. Figure 2 shows a structure of a 
dialogue map. 


Figure 2. Structure of dialogue map 



For example, let us assume a task ‘ordering food’. This task can be consisted of 
some sub-tasks like ‘ Start -> greeting -> choosing main dishes -> ordering side 
dishes -> asking for the bill -> saying good bye -> End’. The sub-task ‘choosing 
main dishes’ would be filled with the following dialogue turns between system 
and user: 
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Task: ‘ordering food’ 

Sub-task: ‘choosing main dishes’ 

Dialogue materials: ‘omelette’, ‘steak and eggs’, ‘French toast’ 
Dialogue turn: 

System: “What would you like to order?” 

User: “I would like to have the omelette.” 

Paraphrase: “I’ll try the omelette.” 

System: “We have two kinds of omelettes, mushroom 
and cheese. Which one would you like?” 

User: “I would like to have the mushroom.” 


3.3. Method of construction 
of dialogue map 

Professional educators build the dialogue scenarios. By using an authoring tool, 
they would make maps from scenarios. The authoring tool is under development. 

First, dialogue scenarios can be produced by the following procedure: (1) set a 
task, (2) set the sub-tasks, (3) set the constraints, and (4) input dialogue turns 
including dialogue materials. A sub-task can also possess its subordinate sub¬ 
tasks. Sub-tasks are similar to concept of script of Schank and Abelson (1977) 
because scripts are structures of actions that describe a chain of events in a certain 
situation. Dialogue materials means core vocabularies of dialogue turns that 
second-language learners have to learn. Dialogue turns are sentences of talking 
between system and user and are constructed by dialogue materials of a sub-task. 
Paraphrases are built on the basis of a representative dialogue turn. 

After constructing scenarios, we can make a dialogue map from the dialogue 
scenarios through an authoring tool with the following functions: (1) convert 
sentences of a scenario to the format of a dialogue map, (2) replace the materials 
with slot variables of the dialogue system, (3) automatically generate dialogue 
acts from sentences, (4) mark the command to directly move from a sentence to 
a sub-task, (5) show the calculus that calculates price, sums the number, and (6) 
visualize whole dialogue map. Figure 3 shows a sample of a dialogue map that 
was built from a dialogue scenario with a task ‘ordering food’. 

A dialogue act is automatically generated from a sentence. For example, the 
dialogue act of the sentence ‘I woidd like to have the <maindishes_name>. @ 
maindishes name = {‘steak and eggs’, ‘french toast’}’ is ‘would_like_to_have_ 
maindishes (maindishes=steak_and_eggs)’ which consists of a verbal phrase and a 
noun phrase like first order logic. 
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Figure 3. A sample of dialogue map of a task ‘ordering food’ 


1. Task setting 


Task=Orderine food 


£2 


Z 


| 2. Sub-task setting [ 


r 1. SubTask=Greeting 

\ 

2. SubTsk=Main Dishes 


3. SubTask=Side Dishes 


4. SubTask=Bill 


V 5- SubTask=Goodbye 

A 


1 


| 3. Constraint setting | 


1. SubTask^Greeting [necessary=no] 

2. SubTask=Main_Dishes [necessary=yes] 

3. SubTask=Side_Dishes [necessaiy=no] 

4. SubTask ^Bill [necessary =yes] 

5. SubTask =Goodbve [necessary=yes] 

. Snblask-Main Dishes .■ SiibTask-Bill 




[ 4. Dialogue turns including dialogue materials ] 


6. Dialogue map 


J2 


& 


5. Dialogue scenario I 


3.4. Discussion 

As mentioned in section 2, it is less time consuming to construct a dialogue 
map, as opposed to dialogue knowledge within an existing dialogue system. 
These maps connect first to a dialogue system and operate normally as a core 
knowledge base of dialogue-based CALL systems. The duration of constructing 
a dialogue map should get shorter because in the near future we will provide the 
educationists with an authoring tool to (1) systematically construct the dialogue 
scenario, (2) automatically convert a sentence into a dialogue act, (3) semi- 
automatically replace dialogue materials with slot variables, and (4) visualize the 
whole dialogue map. 


4. Conclusions 

This paper describes the dialogue-based CALL system based on dialogue maps. The 
format and construction method of dialogue maps were detailed. The authoring tool 
for constructing a dialogue map is under construction. Our goal is that a duration 
of construction of a dialogue map is reduced from a month to two weeks. We are 
planning to expand the tasks of dialogue maps which are not fixed, but are free. 
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Abstract. The purpose of this study is to investigate adult learners’ approaches 
towards Turkish Language (TL) and examine learners’ outlooks towards the use of 
digital technologies for learning. It will also evaluate the impact of the Language 
Lab’s model on learners’ language achievement. Language Lab model is a system 
that is used for learning languages by using technology. It comprises a teacher and 
student console. The role of the teacher console is to offer the control purposes 
while the student console is given the facility to obtain the lessons that have been 
recorded. They are also required to listen to the pronunciations. An example of the 
Language Lab is the digital language lab (Saxena, 2012). The research questions 
of the study were based on whether attitudes towards digital technologies varied 
based on different backgrounds (i.e linguistic, educational, etc). There was also an 
analysis of whether the implementation of Language Lab’s model motivated the 
Turkish as a Second or Foreign Language (TSL/FL) learners of Adult Education 
Programs (AEP) to continue their studies. During this assessment procedure, it 
was identified that students used varied technological tools (Kahoot and Facebook) 
that motivated them to learn foreign languages in an efficient way. In conclusion, 
it can be affirmed that with the adoption and the execution of the above stated 
technological tools, the approaches of the students changed by a considerable 
degree in learning TL within the classroom setting. It is thus worth mentioning 
that the findings of this study can encourage the TL teachers to use technology 
in their classes in order to turn them into more autonomous, student-centered 
teachers using an effective language method in TL acquisition. 

Keywords: Turkish language, attitudes, motivation, technology. 
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1. introduction 

The goal of this research was to investigate learners’ attitudes and motivation for 
learning Turkish, the second official language of the Republic of Cyprus, with the 
help of computer technology. This is further supposed to contribute to the existing 
research in this particular area. In addition, an attempt has been made to evaluate 
the impact of Language Lab’s model on learners’ language achievement. The study 
addressed the following research questions: 

• Did the implementation of Language Lab’s model motivate the TSL/FL 
learners of AEP to continue their studies? 

• What was the impact of the model on learners’ TSL/FLs’ skills? 

2. Method 

2.1. Participants and settings 

TL courses offered by the Language Center (LC) with the cooperation of the Centre 
for Life Long Learning, Assessment and Development (KEPEAA) were designed 
for three different classes. These comprised Turkish B2 language level (intensive 
courses, Jan-May 2015), Turkish B1 language level (Sept-May 2015) and Turkish 
A2 language level (intensive summer courses, May-July 2015) and were delivered 
at the University of Cyprus (UCY) LC’s labs. The study group included 26 adult 
learners enrolled in UCY LC AEP. 

2.2. Data collection instrument 

A mixed method with the inclusion of a questionnaire along with semi-structured 
interviews was used for collecting relevant data to be analysed and then come up 
with the results. The survey was contracted at the LC within the first two weeks of 
August 2015. 

2.2.1. Questionnaire 

The questionnaire was divided into two sections. The first section contained 
biographical information about the participants including age, gender, educational 
background, workplace, acquired languages and language skills. 
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In the second section, the participants were asked to respond to ten close-ended 
questions on their individual perceptions. The answers were made up of a five 
Likert-type scaling instrument, which comprised 62 statements. 

The statements had two forms that were graded as Strongly Agree, Agree, 
Neutral, Disagree and Strongly Disagree and another form to be Never, Seldom, 
Sometimes, Often and Very Often. These questions were asked in order to clarify 
participants’ approaches towards the TL, their learning strategies and evaluation of 
the effectiveness of technology in the language class (Koh, 2015). 

2.2.2. Interview 

The research questions of the Interview included one close-ended question and four 
open-ended questions. The maximum time spent for the interview was 35 minutes. 
The questions were: 

• Why did you decide to learn Turkish? What were/are your motivations to 
learn this language? 

• What kind of language strategies/techniques did/do you use to practice 
your Turkish? 

• Coidd you please indicate how much time per week you’ve spent to study 
your Turkish? 

• Which technological tools used in our class did/do you like most and why? 
Which of the four skills were improved more via technology? 

• Which skills were improved less? Could you please give me an order from 
one to four with an explanation? 

Their responses were accordingly recorded with an MP3 IC Recorder. To bridge 
the procedure of interview scheduling, two polls were conducted with the selected 
participants. 

Three online interviews were conducted in the second week of August (10th- 
14th). Notably, five out of 16 interviews were conducted via Facebook, three via 
Skype, one via Hangouts, one via WhatsApp, five via Viber and one by phone. The 
analysis of the responses along with the discussion of participants’ responses will 
be discussed in the next section of this study. 
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3. Discussion 

According to the results obtained, it was found that a majority of the participants 
(i.e. 81% of the total population) fall in the category of 19 to 25 years of age. This 
response eventually revealed that the generation students that are exposed to wide 
and new levels of technology have started learning foreign languages for finding 
a good job. They have also begun to understand the role played by culture when 
communicating with people of other ethnicities. 

The factor concerning gender did not make any significant distinction in the results, 
as the figure of the male participants was low. The participants usually appeared 
from a diverse background of studies, however, there had been a significant 
concentration observed (42%) to Turkish Studies and (15%) to Byzantine and 
Modern Greek Studies and Law Studies. 

The interview results showed that students usually preferred the use of computer 
technology in the class because with the integration of such technology, they 
managed to acquire better knowledge about Turkish grammar and syntax. These 
lessons proved very useful for them. Interestingly, students were positive on 
whether they learned Turkish lessons in technology-enhanced classrooms and 
especially, with the use of the Labs-model (Station-E Language Lab, 2011). In 
accordance, this particular model has been taken into consideration for discussion, 
as this leads towards developing the language learning procedure by various 
ways that entails saving much amounts of time and amplifying the participation 
level of the teachers and the learners in any classroom setting (Saxena, 2012). 
The positive effects on teaching were accordingly increasing the pace of lesson, 
enriching teaching and increased productivity (Grinager, 2006). Positive effects 
on learning thus mentioned certainly increased students’ interests, along with 
longer attention spans, participation, understanding, performance, communication 
and interaction with enjoyable lessons (Shyamlee, 2012). Only few believed that 
the implementation of technology in class has not much effect on teaching and 
learning quality overall. 

Regarding the effectiveness of the technological tools used in TL classes, the students 
stated that most of the tools used in the class were teaching aids. For instance, 
with the online game Kahoot, Facebook and listening materials consisting of the 
digital tool Vocarro, the students remained active and involved in their learning. 
Moreover, the Pbworks platform had an effective role in language learning. The 
Pbworks platform worked as a tool to develop new learning-styles and innovative 
methods in learning Turkish language. Students hence changed their traditional 
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learning style and thus, integrated the Pbworks platform, which is deemed as an 
interactive approach with positive effects on learners, as per the residts obtained. 

On the other hand, the questionnaire results showed that the WiZiQ platform 
did not contribute a lot to TL learning. WiZiQ is regarded as a virtual classroom 
software that enables the learners to establish a wider connection with one another 
by making better use of chat options and microphones, among others (Figure 1). 
Some students, through their interviews, explained that within the setting of a 
virtual classroom, they were quite anxious and not comfortable to talk in front of 
the camera. Nevertheless, face-to-face classes were observed as more confident to 
speak and remain active throughout the language learning session. 


Figure 1. Effectiveness of digital technologies 


Ranking between 
technology tools 


Facebook - Group page; synchronous discussions with instructor and 
with peers 

PBworks platform especially created for this class; asynchronous 
discussions with instructor and with peers 
Padlet - for announcement and for sharing wishes, photos etc 
Online diary [embedded in PBworks platform - individual page for 
each student] 

Power Point Presentations 
Kahoot - In class language game 

Quia - online games- outside class [embedded in our PBworks 
platform] 

Learning Apps. Org online games- outside class [embedded in our 
PBworks platform] 

WiZiQ tests - in class self-assessment language test 

Google form-test - in class self-assessment language [embedded in 

PBworks platform] 

Viber - Our Group- synchronous discussions with instructor and with 
peers 

WiZiQ - online synchronous discussion website 
Doodle - for making a poll [embedded in our PBworks platform] 
Makes belief Comix online task activity - in class [then embedded in 
our PBworks platform] 




IHH 



na 


4.9 

4.8 


4. Conclusions 

With the conduct of a mixed research approach by performing questionnaire 
surveys as well as interviews, a detailed viewpoint of the students regarding their 
TL experience, knowledge of technologies being used in the classrooms and their 
motivation level was ascertained in this study. The results of the survey and the 
interviews thus showcased the fact that the implementation of technology in 
class has enormous effects on teaching and learning the Turkish language. Such 
effects can be determined in distinct ways that entail learning TL grammar and 
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syntax more quickly and communicating with others belonging to diverse cultural 
backgrounds in an efficient way. Thus, in conclusion, it can be inferred that the use 
and the integration of digital technologies, within the learning procedure, possesses 
the capability to improvise the learning procedures of the students and at the same 
time, motivate them to embrace those in making wider advancements in their 
future career. 
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Abstract. The potential for computer-supported learning in educational contexts 
has opened up the possibilities for learners to interact in informal contexts 
outside the classroom. The context of the present research is a young American 
individual’s vlog on YouTube sharing his experiences as a learner of French. This 
paper focuses on the potential use of vlogs for developing language speaking 
skills and intercultural exchanges between users. The aim of the study is to 
describe and analyse informal learning communication using a vlog between one 
American French Language learner posting his learning experiences on YouTube 
and his audience. We highlight learner’s opportunities in terms of speaking and 
intercultural skills in a vlog environment. This study is based on an empirical 
method of collecting ecological data on the web. The qualitative data analysis 
method is based on the description of the online conversation (Develotte, Kern, 
& Lamy, 2011) in addition to interaction analysis and technodiscursive analysis 
(Paveau, 2015). We discuss the qualitative findings of the research conducted on 
this multimodal corpus in order to highlight the vlog’s potential for supporting 
informal language learning, speaking and intercultural exchanges between 
YouTube users in a globalised world. 

Keywords: informal language learning, intercultural communication, social 
networking, vlogging. 


1. Introduction 

Web 2.0 tools use for online language learning and intercultural exchanges 
have grown significantly. Guth and Helm (2010) class Web 2.0 tools into three 
categories that can serve as a platform for communication and collaboration: 
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social networks, wikis and blogs. However, media sharing communities such as 
Flickr and YouTube are excluded from this category. It is the latter (YouTube) 
that we are interested in, as it is likely to encourage online autonomous language 
learning (Barton & Lee, 2013) and yet is quite unexplored in the context of 
French language learning. Previous research highlighted learner’s 2.0 skills 
(Guth & Helm, 2010). Our research focuses on what Herring (2015) calls 
emerging phenomena in digital communications: Web 2.0 platforms that support 
a convergence of channels or “modes” (text, audio, video, images) for user-to- 
user communication (Herring, 2015, p. 1). 

As recalled by Blommaert and Rampton (2011), “over the past two decades, 
globalization has altered the face of social, cultural and linguistic diversity in 
societies all over the world” (p. 1). Concepts such as migration and multiculturalism 
have gradually been replaced by what Vertovec (2007) calls superdiversity. In this 
context, the emergence of new medias and technologies of communication are 
intensifying globalisation and are complicating the notion of superdiversity. 

We discussed previously (Combe, 2014) the emergence of the vlog genre, a 
particular kind of vlogging as a way to practice languages online while learning. 

Our study focuses on the following research question: What opportunities do a 
learner's vlog present in enhancing their speaking and intercultural skills? This 
paper is divided into three parts. Firstly we will present the theoretical and the 
methodological frame, then we will present the corpus of study and the results 
of our research. 


2. Method 

2.1. Methodological framework 

The research protocol is based on an empirical method of collecting ecological 
data. Our research studies what Paveau (2015) defines as a ‘digital’ document, 
that is, a document natively produced online, on a website, a blog, a social 
network or any digital environment where speech acts take place (in this specific 
context the YouTube platform). 

In order to analyse users’ comments on YouTube, we applied Bennett’s (1986, 
1993) conceptual tool, the Developmental Model of Intercultural Sensitivity 
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(denial, defense, minimisation, acceptance, adaptation, integration) to 
understand personal reactions and better discern the criteria of adaptation to 
another culture. Bennett’s (1986) scale of six ranges of sensitivity to difference, 
aiming to underline individuals’ cognitive concepts of cultural experiences, are 
an interesting tool for understanding emotional and conventional reactions when 
faced with culture shock in digital environments. The typology of the six stages 
is presented in a continuum: we explored to what extent the YouTube comments 
fall within Bennett’s (1986) scale. However, the development of intercultural 
sensitivity follows a line of continuous progress (Bennett & Bennett, 2004). 
The continuum of stages is not static, as opposed to the written comments on 
YouTube, which once posted, if not clarified or restated by users, appear to be a 
definitive statement. 

The qualitative data analysis method is based on Computer-Mediated Discourse 
Analysis (Herring, 2015) combined with recent French research on discourse 
and interaction analysis in digital contexts (Develotte, 2012; Paveau, 2015) and 
Bennett’s (1986) scale of intercultural sensibility. 

We adopted a semio-discursive approach in order to analyse a vlogger’s discourse. 
Additionally, we proceeded to a preliminary heuristic analysis of the corpus of 
all comments based on what YouTube calls Top Comments, that is, comments 
YouTube users vote as the best, and have sought to manually track the number 
of polylogues, the number of responses they generated and the number of users 
who took part in the interaction. 

2.2. Corpus 

Given the scale of the data and the instability of the multimodal online research 
corpus, we selected a corpus of reference from the vlogger’s ‘texfrancais’ channel 
content 3 . This corpus, determined as of 5 January, 2016, consists of 38 videos, 
0:10 - 15:56 minutes published from 28 June, 2011 and the written comments 
they inspired. 

Our corpus of study consists of three vlogs (‘Unpronounceable words for 
us Americans’, ‘Differences between France and the USA’ and ‘American 
Slang’) for a total of over 14 minutes and more than 7000 comments posted 
on YouTube. 


3. https://www.youtube.com/user/texfrancais/videos 
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Table 1. Corpus of study 



Title 


Unpronounceable 
words for us 
Americans 


The differences 
between France 
and the USA 


American slang 


Published 


14/01/2012 


09/01/2013 


05/03/2015 


Duration 


5’09 


5’34 


4’48 


Comments 


5,386 


1,628 


210 


Views 


1,050,382 


141,616 


26,303 


I like this 


28,278 


3,738 


2,283 


I dislike this 


251 


80 


3. Discussion 

The first results of our research show that the vlogger is widely encouraged by 
peers (we observe strong socio-emotional aspects), exchanges take place on a 
multilingual environment, the vlogger is both a learner and a teacher (he practices 
French but also teaches American slang), and users share knowledge and comments 
in informal ways (without signs of stress or formality). 

Vlogs offer the possibility to practice spoken production skills as recommended 
by the Common European Framework Reference for languages. This skill is 
often difficult to implement in an authentic context of communication outside the 
classroom. Vlogs have the potential to help develop digital literacy and speaking 
skills in front of a camera and encourage publication (speech acts and gestures, 
improving the final media product before posting it, adding text, and emoticons 
which illustrate speech acts). Topics such as lexicon and pronunciation generate 
exchanges, which lead to rich debates. Vlogging appears to be a space for 
collaboration and hetero-peer learning. It was observed that users often offered 
linguistic explanations without demonstration expertise in phonetics. Flence 
attempts to explain how to pronounce words appeared to be limited by both the 
medium (YouTube comments) and peers’ knowledge of the topic. Additionally, 
vlogs are useful in helping negotiate the meaning of words in foreign language. 

However, in contrast, intercultural issues can crystallise tensions. Vlogging space 
on the Internet is also conductive of exchanges on cultural issues or statements 
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questioned by users and conflict of opinions about stereotypes. The vlogger’s 
perceptions rise various comments in which users express their own cultural 
perceptions on topics that the vlogger posted, and raised reactions on a local level 
(France and its regions) and differences of point of view on Paris and the rest of the 
France, dividing users in in-groups and out-groups (Bennett, 1993). Ethnocentric 
attitudes of denial, defense and minimisation demonstrate some users’ inter¬ 
regional cultural bias. Other users minimised their in-group and out-group division, 
and we also noticed some cases of acceptance and integration. One of the users in 
particular takes each point developed by the vlogger and positions herself with 
respect to these points, demonstrating the acceptance stage of Bennett’s (1986) 
scale on topics such as the school system in France, smoking in high school, and TV 
channels, and gives a personal explanation on youth behaviour in France. Hence, 
vlogs have inherent limitations in enhancing speaking and intercultural skills. 

Finally, commercial, ethical and privacy aspects of sharing on social networks need 
to be considered when using online interactions in pedagogical contexts. 


4. Conclusions 

This study highlights the vlog’s potential for supporting informal language 
learning and intercultural exchanges between YouTube users in a globalised world. 
The vlogger becomes an almost fictional character, a movie character or a digital 
character through the looking glass of the screen between him and his followers. 

Our case study, through the example of a vlog (‘texfrancais’ channel), shows the 
potential of new multimedia and multimodal interactions for informal foreign 
language practicing and learning. On the one hand, vlogs offer opportunities for 
speaking skills, digital literacy skills, multilingual peer learning, and opinion 
conflicts through cultural stereotypes, and intercultural skills. On the other hand, 
vlogs are limited by the ethical aspects of social networks and by the linguistic 
skills of social network users. In a formal teaching context, ‘texfrancais’ channel 
can be a resource for teachers in order to think about the potential of a multimodal 
interactive platform to practice a language and develop digital literacy skills. 

This case study raises important questions in the era of mass digital communication 
in a globalised world where the interactional reference space has diversified. 

More research is needed to analyse interactions in an unstable context of production 
and study how language vlogs could be of interest from a pedagogical point of view. 
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Abstract. Study abroad programs provide an opportunity for students to accelerate 
language learning and acquire cultural capital. Evaluations of returnees from study 
abroad programs however, have revealed that this is not always guaranteed. To 
promote a more positive academic and culturally-inclusive study abroad experience, 
one recommendation is for language teachers to focus on students’ digital literacy. 
Given the reported levels of poor digital literacy among Japanese freshmen students, 
the researchers in this current study were attempting to determine if this wider trend 
applied to students at their private university in Tokyo. The authors surveyed first- 
year College of Tourism and Hospitality (CTH) students and will report on their 
responses to two sections of a computer literacy questionnaire originally created by 
Son, Robb, and Charismiadji (2011). The first section focuses on self-assessment 
of digital skills, while the second section reports on the results of a 10-item digital 
literacy test. 

Keywords: digital literacy, Japanese university, CALL, English for specific purposes. 


1. Introduction 

This paper reports on the second phase of the researchers’ investigation into how 
to prepare Japanese students in the CTH for a one-year study abroad program in 
Australia. In the initial phase, returnees from the first student cohort of the program 
were surveyed (Milliner & Cote, 2016). Key findings from this investigation were 
that students appear interested in improving their digital literacy; they recognize 
the necessity of digital literacy in higher education and beyond; many believed that 
their digital skills were inferior to their classmates in Australia; and, they reported 
using their computer more in Australian university classes. 
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In this second phase, 112 students from the 2016 freshmen cohort were surveyed on 
issues relating to computer ownership and accessibility, capability of performing 
tasks on mobile devices and PCs, personal and professional use of computers, and 
general interest in Computer-Assisted Language Learning (CALL). In this paper, 
however, student’s self-assessment of digital skills and digital literacy test results 
are described. 


Figure 1. The Information and Communications Technology (ICT) skills review 
for CTH students 


Review 2015 
returnees’ 


Survey to establish 

experience in 
Australia 


digital literacy 


I 


Make recommendations for 


Survey & interview 

using ICT and giving ICT 


2016 returnees 

training for CTH students 

◄- 

from Australia 


2. Literature review 

2.1. Digital literacy 

Learning to use digital technology has become a crucial step in developing literacy 
in the twenty-first century (Goodwin-Jones, 2000) and teachers are being asked to 
consider how they can effectively prepare students to develop and exercise their 
digital literacy skills. Corbel and Gruba (2004, p. 5) argued that students need 
computer skills to 

• communicate effectively in society; 

• interact with family and friends; 

• function effectively in the workplace; 
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• learn new ideas and for fun and pleasure. 

While traditional ‘literacy’ has been defined as the ability to read and write, the term 
‘digital literacy’ appears to be more complex. The U.S. Department of Education 
(1996) defined digital literacy as having “computer skills and the ability to use 
computers and other technology to improve learning, productivity and performance” 
(p. 5). Barrette (2001), and Corbel and Gruba (2004) argue that digital literacy 
contains two core components: (1) ability to control basic computer operations, and 
(2) using one’s understanding of computers for problem-solving and critical thinking. 

2.2. Japanese student literacy 

Although Japan is perceived as digitally-wired, it is well documented that digital 
literacy among Japanese youth is falling behind other countries. This is despite 
the fact that the Japanese Ministry of Education, Sports, Science and Technology 
(MEXT) ordered the inclusion of information computing technology in high 
school curriculums (MEXT, 2011). In a 2011 report by MEXT, they acknowledge 
that ICT utilization in Japanese schools has not been advancing at rates similar 
to those in other industrialized nations. In 2015, the Organization for Economic 
Co-operation and Development (OECD, 2015) released a critical statement on 
the literacy of Japanese youth, noting that 25% (age 16-29) lack basic computer 
skills. One explanation is that schools are not responding to the MEXT mandate 
to implement ICT training. In fact, contemporary reviews of freshmen Japanese 
university students also noted that many students did not use ICT in high school and 
most have low levels of digital literacy and confidence using digital tools (Gobel & 
Kano, 2014; Lockley & Promnitz-Hayashi, 2012; Murray & Blyth, 2011). 

2.3. Digital literacy and study abroad 

For CTH students studying in Australia, poor digital literacy may be limiting 
language-learning opportunities (Murray & Blyth, 2011), chances to engage in 
Australian culture (Kinginger, 2011), and their ability to function in the foreign 
society (Brine et ah, 2015). ICT skills were identified by Jarman-Walsh (2015) 
as crucial for students studying abroad because they often work independently to 
solve personal and academic-related problems. Understanding multimedia and 
social networking programs have also been cited as useful approaches for students 
studying abroad because they can (1) access resources and strengthen relationships 
(Jarman-Walsh, 201 5), (2) practice informal communication with peers (Kinginger, 
2011), and (3) explore the communicative norms used by locals (Kinginger, 2011). 
While most study abroad research focuses on development of cultural awareness 
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and language proficiency (e.g. Sato & Hodge, 2015), the examples above illustrate 
the role digital literacy skills can play in academic and social environments. 


3. Research methods 

3.1. Research questions 

This study aimed to answer the following questions: 

• At what proficiency level do freshmen students rank their digital literacy? 

• What are the actual levels of digital literacy based on results from a digital 
literacy test? 

3.2. Participants, demographics and computer experience 

Responses from 112 freshmen students in the CTH were analysed for this study. 
A total of 29 males and 83 females (age 18-19) responded to the questionnaire. 
All (112) own a smartphone and a PC. When asked whether they used a computer 
daily, two thirds responded ‘yes’. As a follow up, they were asked to specify where 
they usually used their computer. The locations identified most included: home 
(77), anywhere (30), and school/university (9). 

3.3. Questionnaire 

The 2016 freshmen cohort were asked to complete a digital literacy questionnaire 
adapted from a seminal survey created by Son et al. (2011). The entire survey 
contained 28 items, however only two sections are focused on for this report. 


4. Results 

4.1. Self-assessment of digital skills 

When asked to self-assess their digital proficiency, the responses revealed 
profoundly low appraisals. Displayed below (Table 1), very few students perceived 
their skills as being ‘above average’ or ‘high’ for each question. 
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Table 1. Self-assessment of digital skills 


Question 

Low 

Below 

Average 

Average 

Above 

Average 

High 

How would you rate your 
computer skills? 

30 

34 

39 

8 

1 

How would you rate your 

Internet literacy? 

29 

35 

41 

7 

0 

How would you rate 
your typing skills? 

41 

26 

36 

8 

1 


4.2. General computer knowledge 

Students answered ten multiple-choice questions designed to appraise general 
computer knowledge. Surprisingly negative results were observed for the majority 
of these questions (see Table 2 below). In only four out of the ten questions, more 
than 50% of the responses were correct, and in six out of the ten items, ‘I don’t 
know’ was selected by more than 50% of students. 


Table 2. Digital literacy test results (Son et al.. 201 1) 


Question 

Correct response % 

I don’t know % 

What is a folder? 

77% 

13% 

How many characters are allowed for a tweet? 

69% 

21% 

What is a URL? 

63% 

12% 

Which of the following is not a search engine? 

55% 

35% 

What is the main brain of the computer? 

32% 

52% 

What is the main function of a server 
in a networked environment? 

31% 

54% 

What kind of program is used to 
edit a GIF file or a JPEG file? 

28% 

56% 

How much information fits 
on a CD and a DVD? 

16% 

67% 

Which of the following is considered 
poor email etiquette? 

6% 

39% 

What are WAV and AIFF examples of? 

7% 

82% 


5. Discussion 

The authors of this investigation established that freshmen in their Japanese 
university believe their digital literacy proficiency to be very low. These low 
appraisals were reinforced by poor results in the digital literacy test section. 
One limitation in this study is a reported tendency among Japanese students to 
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modestly self-assess their own digital skills (Lockley & Promnitz-Hayashi, 2012). 
A practical test of digital tasks (e.g. analyzing a spreadsheet) may have provided 
a better assessment. However, the evaluation of results in the digital literacy test 
questions somewhat validate their own low self-assessment. 


6. Conclusion 

To prepare students for a study-abroad program, the authors set out to identify 
freshman students’ level of digital literacy. The results echo other Japan-based 
studies, as almost all students had very low self-assessments of their digital skills, 
and respondents returned very poor results in the digital literacy test. Although 
smartphone ownership and personal computer ownership is at 100%, students do 
not appear to be using these devices in any depth. 

After completing a more detailed report of this survey’s data, the researchers 
will interview the second group of returnees upon returning from Australia in 
September 2016. The goal is to develop a training program which appropriately 
equips students with the digital skills that can support a more prosperous study 
abroad experience. 
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Digital story (re)telling using graded 
readers and smartphones 
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Abstract. Extensive reading and digital storytelling can utilise ‘the power of stories’ 
effectively to enhance learners’ receptive and productive skills. For the past five 
years, the author has been working on a classroom project combining these two 
activities, as a way of integrating Information and Communications Technology 
(ICT) into his reading-oriented English as a Foreign Language (EFL) courses. Each 
year the project has continually been updated and improved, reflecting the results and 
challenges from previous years. In this paper, the project implemented throughout 
the past two years (2014 and 2015) is reported on, particularly focusing on how the 
project improved regarding ways the story should be analysed and then how the 
digital stories should be created. It was found that the students were favourable to 
our new attempts - using smartphones for digital storytelling and retelling a story 
from the viewpoint of two characters. On the other hand, the way individual work 
and group work should be balanced has room for improvement. 

Keywords: digital storytelling, MALL, extensive reading, BYOD, smartphones. 


1. Introduction 

There are several benefits that are expected by combining extensive reading (reading 
a lot of easy texts written in the target language) and digital storytelling (creating a 
movie clip made from text, images, sounds, and narration). First, it enables learners 
to input and output the target language with special attention to the structure of 
narrative texts. The graded readers, written or retold with a controlled range of 
vocabulary, could make the analysis of literary texts more approachable to learners 
than the authentic literary works that are often too challenging. Second, the digital 
stories can be easily shared and learned beyond the class - they can be stored in a 
repository that future students can use for their learning. Thus digital storytelling 
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can be a communicative activity in that the creators should be conscious of the 
audience beyond the class and time. 

The author reported at EUROCALL 2014 on his previous classroom project, 
where each group of students in his class was requested to choose a book from the 
graded readers they had studied and, based on that story, create a digital story using 
Microsoft PowerPoint installed in the Computer-Assisted Language Learning 
(CALL) room at the university campus. While the project involving story analysis 
and digital storytelling provided the students with deeper understanding of the 
narrative texts they read, the challenging process of creating a video clip on PCs 
made them focus on the technology rather than learning the target language; also 
they found it quite cumbersome to write a summary of a book as a group activity. 

There were two major improvements in the classroom practice reported in this 
paper: First, instead of the PCs in the CALL room, Mobile-Assisted Language 
Learning (MALL) devices were integrated into the process. It was expected that 
the high penetration rate of smartphones among the college students in Japan 
would make it easier for them to create digital stories using a widespread- 
owned device. The convenience of MALL on a ‘bring your own device’ basis 
would enable them to focus more on the content of the materials rather than the 
technology they have to cope with. And second, instead of writing one summary 
in each group, they were requested to choose two characters from the book they 
were studying and let each of them narrate the story, so that the same story could 
be retold from multiple points of view. 


2. Outline 

The project was conducted through an EFL reading course, ‘Advanced Reading’, for 
advanced and motivated learners at a national university in Japan, during the autumn 
semester of the academic years 2014 and 2015. The number of participants were 
27 in total (17 in 2014 and 10 in 2015). The primary aim of the project is to direct 
learners’ attention to the story structure while developing their reading/oral fluency. 

The extensive reading activities were carried out outside the class, since it was 
merely a part of the 15-week-long course, covering a variety of strategies for 
reading different types of texts. A collection of 350 graded readers, composed of 
Oxford Bookworms and Macmillan Readers, were brought into the classroom 
every week so that the students could check them out and study outside the class. 
The students were encouraged to read 150,000 words or more during the 15 weeks. 
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At the ‘Book Talk’ in week five, the students talked in groups of three or four about 
the books they had read, and then each group chose one book that the majority of 
the members found interesting. Then they worked in groups to analyse the books 
they chose in terms of plot structure and characters, using multiple tools of analysis 
such as Dillingham’s (2001) Visual Portrait of a Story (adapted by Ohler, 2008) 
and Greimas’s (1966) Actantial model. Based on the analysis, they collaboratively 
wrote two stories, each of which were narrated by two different characters that 
appear in the same book. 

After having their stories read by their peers and proofread by the instructor and 
practicing reading them orally, the writers recorded them and created video clips, 
adding some visual images and background sounds that might help the audience 
understand the story. The whole process was carried out by exploiting smartphones 
owned by the students; Videolicious, a free and easy-to-use digital storytelling app, 
was used for this purpose. Since the maximum length of a video clip that can be 
created with Videolicious is one minute, the students needed to plan and practice 
their narrations to fit it within the time limit. In order to minimise the work time on 
the project in the classroom, the campus learning management system (‘Bb9’) was 
used to let the students share stories they had written among other group members, 
and collect the digital stories they had created. The movie clips were shared and 
peer evaluated on Bb9. 

3. Results 

A questionnaire survey, made up of ten items with a five-point Likert scale, was 
given at the end of the semester. There were 26 respondents in total. They were also 
asked to write comments on the project. The question items and results are shown 

in Table 1 and Figure 1. 

Table 1. Questionnaire items 

1. It is meaningful to retell the book from the viewpoint of one character. 

2. Summarising and recording a story help me leam English. 

3. Watching digital stories of the books I haven’t read makes me want to read them. 

4. Choosing a book for digital storytelling at the time of the Book Talk is appropriate. 

5. The period of time and the deadline given for digital storytelling are appropriate. 

6. It is all right to use my smartphone for my course assignments. 

7. Pair/group work helps create a digital story. 

8. Structural analysis of a story helps create a digital story. 

9. Structural analysis of a story helps me understand other stories. 

10. Overall, creating a digital story is meaningful in this course. 
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Figure 1. Survey results of Q1 -10 (N= 26) 


2 ! 


30% 40% 50% 60% 70% 

□ 5 □ 4 □ 3 E3 2 ■ 1 □ n/a 


The percentages of the positive feedback (4 and 5) are as follows: 80.8% 
(Ql), 84.6% (Q2), 65.4% (Q3), 73.1% (Q4), 80.8% (Q5), 88.5% (Q6), 50% 
(Q7), 73.1% (Q8), 69.2% (Q9), 61.5% (Q10). Q3 (Learning from other digital 
stories), Q7 (The effects of pair/group work), and Q9 (The usefulness of 
structural analysis) were relatively weak. (Though Q10 also looks weak, there 
were 3 respondents that gave no answer. The reason being that they just missed 
the last question). 

Among the positive comments: 

• There was a lot to learn from the project, like reinterpreting the story from 
the viewpoint of a character and performing the character in creating the 
digital story. 

• The whole process of digital storytelling was a new and interesting 
experience for me. 

• It was a good opportunity to practice reading my story with the audience 
in mind. 

And here are some of the points the students found challenging: 


135 



























Kazumichi Enokida 


• Using Videolicious was challenging. 1 had to record a couple of times to fit 
my script within the time limit of one minute. 

• It would be better to have more time for group discussions; I don’t really 
feel that my group collaborated our digital story. 


4. Discussion and conclusion 

The students viewed combining extensive reading and digital storytelling as 
an effective way to improve their four language skills and read narrative texts 
analytically. It was also found that overall the students were favourable to our new 
attempts to use smartphones for digital storytelling and then to retell the story from 
the viewpoint of two characters. It is also worthy to highlight that the students 
were extremely keen to use their own personal mobile devices for their course 
assignments. The convenience of creating a digital story using smartphones can be 
compared favourably with the technical challenges of doing so involving desktop 
PCs that have been previously reported on by the author. 

On the other hand, the manner in which both student individual and group work 
should be balanced does have room for improvement. For example, more time 
should be spared for group discussions in the classroom throughout the whole 
process of the project as this will enhance the students’ awareness of the project as 
a collaborative activity. Also, further investigation should be undertaken regarding 
what makes it relatively difficult for the students to learn from the digital stories 
shared by their classmates. 


5. Acknowledgement 

This work was supported by JSPS KAKENH1 Grant Number 16H03450. 


References 

Dillingham, B. (2001). Visual portrait of a story: teaching storytelling [School handout], Juneau, 
Alaska. 

Greimas, A. J. (1966). Structural semantics: an attempt at a method. University of Nebraska Press. 
Ohler, J. (2008). Digital storytelling in the classroom: new media pathways to literacy, learning, 
and creativity. Thousand Oaks: Corwin Press. 


136 




EUROO 

|> 



HR4EU - a web-portal for e-learning of Croatian 
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Abstract. In this paper, we present the HR4EU - a web portal for e-learning of 
Croatian. HR4EU is the first portal that offers Croatian language courses which 
are free-of-charge and developed by language professionals. Moreover, HR4EU 
also integrates bidirectional interaction with some of the previously developed 
language resources for Croatian. The HR4EU portal offers three general (beginner, 
intermediate, advanced) and two specialized (Croatian for business users, Croatian 
for students) Croatian language courses. Apart from language courses, the portal 
also offers information about Croatia presented via interactive maps, as well as 
other infonnation, which can be useful to foreigners living or studying in Croatia. 
Moreover, HR4EU introduces users to language resources and shows them how they 
can efficiently be used when learning a new language on their own. 

Keywords: e-leaming, Croatian language, European project, language resources. 


1. introduction 

in this paper, we present HR4EU, a web-portal for e-leaming of Croatian (www. 
hr4eu.eu, www.ln-4eu.hr, cf. homepage in Figure 1), developed at the Faculty of 
Humanities and Social Sciences in Zagreb and funded by the European Social Fund. 

Since Croatian is a language with a relatively small number of speakers, its presence 
on the web is limited, especially when it comes to e-learning courses of Croatian. 
A few e-learning sites offering users the possibility to learn Croatian are either 
expensive or present learning material in a static manner, avoiding the usage of 
existing language technologies. With the HR4EU portal we aim to bridge this gap 
and develop a modern e-learning system which integrates bidirectional interaction 
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with previously developed Language Resources (LRs) 4 . This e-learning system is 
developed by linguists, who are native speakers and have experience in building 
LRs. Moreover, great efforts were made to make this portal visually attractive. 



2. HR4EU portal 

The HR4EU portal is divided into four sections. The section Courses consists of 
three general (beginner, intermediate, advanced) and two specialized (Croatian for 
business users, Croatian for students) Croatian language courses (cf. Section 3). 

The section About Croatia provides the cultural context for learning Croatian via 
nine interactive maps: borders, cities, culture, events, people, nature, wine, food, and 
recipes. By clicking the pins on the maps, pop-up windows appear and users can read 
about peculiarities related to the part of Croatia where the pin is located (cf. Figure 2). 

Figure 2. Section About Croatia 



4. Cf. section 2 and 3.1. LRs are primarily used for natural language processing, but they can also be used as tools in CALL, 
especially in courseware engineering (cf. Colpaert, 2004, p. 17). 
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The section Living in Croatia offers useful information to foreigners in Croatia, 
e.g. list of important institutions (e.g. Ministry of Interior), and forms that they may 
be required to submit during their stay in Croatia (e.g. visa application). 

The section dedicated to language resources provides users with the introduction to 
the Croatian LRs: Croatian National Corpus (hnk.ffzg.hr), Croatian Morphological 
Lexicon (hml.ffzg.hr), Croatian Wordnet (crown.ffzg.hr), Croatian Dependency 
Treebank (hobs.ffzg.hr), and CroDeri V - Croatian Derivational Lexicon (croderiv. 
ffzg.hr). These resources can be useful when learning Croatian and are used as 
helpful tools (so-called - HINT, cf. Figure 3) in completing assignments throughout 
the HR4EU courses. The section also includes a short video-tutorial for each 
resource and a link to the respective search interface. 

Figure 3. Using LRs in courses 


What is the gender of the given noun? 


ruka 



points 


Your answer: neuter 

Incorrect! 

Check in HML! 


3. Courses at HR4EU 

3.1. General courses 

Although there is an extensive literature on teaching Croatian as an L2 (e.g. Barac- 
Kostrencic, Kovacicek, & Lovasic, 1982; Cilas-Mikulic, Gulesic, Machata, & Udier, 
2008, 2011; Jelaska et ah, 2005), authors exclusively focus on classroom teaching. 
We have consulted the grammar and topics they cover, but we needed to adapt it 
to fit a completely different approach to language learning, i.e. learning a foreign 
language using a language learning software. Courses available at the HR4EU portal 
are developed in Moodle (www.moodle.org), an open source e-learning platform, 
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which provides course developers with numerous tools and activities that can be used 
in an e-learning course (e.g. interactive lessons, quizzes with multiple question types, 
dictionary, books, assignments). Consequently, the language material also had to be 
adjusted to the possibilities that this platform offers. 

Each general course is divided into ten lessons: four lessons with new content are 
followed by a revision that covers the material learned thus far. Lessons comprise 
of several parts: the lesson body, grammar book, quizzes, and Practice your writing 
skills tasks. Each part focuses on the acquisition of different language skills (grammar, 
writing, reading, listening) and different cognitive strategies of language learning 
(e.g. repetition, resourcing, translation, etc., cf. Douglas Brown, 2007, p. 135). 

The lesson body includes short grammar descriptions, word lists accompanied by 
audio tracks or illustrations or cultural peculiarities (‘content pages’), and question 
parts (‘question pages’). Content and question pages interchange in order to keep the 
user concentrated on the content 5 . Moreover, each lesson includes one or more short 
conversations or texts about the lesson topic. For the purpose of the HR4EU courses, 
more than 1600 audio records with vocabulary and conversations were taped 6 , and 
over 150 digital illustrations were made that help users to learn the vocabulary 7 . 

The lesson body is followed by a more elaborate grammar part - grammar book. 
Grammar books follow the grammatical content from their respective lessons, but 
they can also be read separately, and downloaded or printed as a PDF document. The 
grammar books are also very useful for question parts of the lessons and for quizzes, 
especially due to their clear structure and large amount of examples they offer. 

Each lesson consists of two quizzes - one is dedicated to practicing grammar, 
orthography and vocabulary, while the other is dedicated solely to practicing 
vocabulary. Quizzes comprise of different kinds of questions (e.g. cloze, multiple 
choice, matching, ordering, short answer, etc.). Just as in lesson’s question pages, 
each question has two additional plugins: FUNT and NOTE buttons. They provide 
users with help when they answer a question incorrectly, or with additional 
information about words or grammar used in the question if they answer it correctly 
(cf. Figure 3 and 4) 8 . 


5. Fleming (1987), according to Fahy (2004), stresses that “change and variety can help to create and sustain attention” (p. 145). 

6. Newby et al. (2000) state that the combination of audio and print is a powerful alternative to reading alone. 

7. According to one of Mayer’s (2001, p. 68) principles that govern the impact of multimedia in teaching, students learn better 
when the words are combined with pictures. 

8. According to Fahy (2004), users require feedback that enables “them to monitor their progress, to discover errors or 
misconceptions, and to recognize what they should do differently (or continue to do) to gain further proficiency” (pp. 142-147). 
Feedback differs according to the users’ level. Therefore, we offer two-leveled feedback: (1) the information concerning the 
correctness of the answer, and (2) more elaborated feedback, which opens only when the user clicks the HINT or NOTE button. 


140 





HR4EU - a web-portal for e-learning of Croatian 


Figure 4. NOTE button 



© 


points 


glava 


Your answer: zenski rod / feminine gender 

Great! 


Q 



Do you remember? glava = head, f. sg. 



The HR4EU courses integrate bidirectional interaction with previously developed 
LRs. The lessons and quizzes are designed to encourage users to use LRs, e.g. to 
find the appropriate word form in Croatian Morphological Lexicon 1 ’ or to learn 
semantically related words via Croatian Wordnet. However, our language learners 
often do not have a linguistic background, so some of the resources, e.g. Croatian 
Dependency Treebank, were modified in order to be used more easily in CALL. 
We have built a sub-corpus of Croatian Dependency Treebank that consists solely 
of the sentences from HR4EU courses and provides users with their syntactic and 
semantic role structure. We have also built the SynSem Visualizer 10 , a tool which 
enables graphical representation of syntactic and semantic sentence structures. 

This system is designed in a way that makes language learners helpful in the 
improvement of existing LRs. We will use learners’ activity to enhance and enlarge 
existing LRs by tracking their activity yielding empty results, and adding them to 
the respective resources 11 . 

3.2. Specialized courses 

Since our main target groups of users are foreigners who are going to study 
or work in Croatia, we have offered two more courses at the HR4EU portal. 


9. CML provides users with the information about the lemma of the word form, or about all possible word forms of a lemma. 
Cf. video-tutorial at http://www.hr4eu.lu-/croatia/resources/. 

10. http://hobs.ffzg.hr/en/search/ 

11. E.g. if the user searches for the word recept ‘recipe’ in CML and doesn’t find it, we will add it to CML based on user’s 
empty result. 
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namely Croatian for business users and Croatian for students. These courses offer 
specialized vocabulary related to business or education. Each course consists 
of four lessons that cover everyday business or student life. The final lesson of 
specialized courses is followed by writing assignments. Here, users can learn 
how to write a CV, job application or letter of motivation/recommendation in 
Croatian. 


4. Conclusion 

In this paper, we have presented the HR4EU portal, a free-of-charge web portal for 
the e-learning of Croatian. It is one of few free e-learning sites that offer Croatian 
language courses and is developed by linguists, who are also native speakers of 
Croatian. The portal introduces language learners to Croatian language resources 
and their usefulness in learning a new language. As learners become aware of 
possibilities these resources offer, they can also use similar LRs in learning other 
languages as well, because similar resources are built and freely available for 
dozens of different languages. 
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Abstract. In the context of a Language Massive Open Online Course (LMOOC), 
teacher interventions have to be designed into the course, since personalized teacher 
feedback actions are impossible due to the large number of participants. Learner 
autonomy, peer-feedback and task design are crucial in this course design. This 
paper presents a study on the task design effect on participants of a tandem MOOC 
(English-Spanish). The tandem MOOC takes advantage of the massive aspect of 
a MOOC to provide learners with ample opportunity for language use with native 
speakers of their target language, and access to peer-feedback. The tasks provide 
content and an objective for the conversations, turning them into episodes of 
meaningful language interaction. The study is conducted through observations of 
eight video recorded conversations by two learners of English carrying out four 
different tasks, eight tasks in total, with five different learners of Spanish, as it will 
be explained in more detail in the methodology section. The results show that task 
types had an effect on students’ performance, but variables such as proficiency also 
played a role in learner interaction. 

Keywords: e-tandem, MOOC, task design, student performance, student interaction. 


1. Introduction 


This paper explores the effect of task design in a new web 2.0 collaborative learning 
environment that contributes to Synchronous Computer Mediated Communication 
(SCMC) and Computer Assisted Language Learning (CALL) research. The 
tandem MOOC (Appel & Pujola, 2015) is an LMOOC which offers online 
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speaking practice for learners of Spanish and English. It is based on the synergy of 
e-tandem and Task-Based Language Teaching (TBLT). In e-tandem settings, two 
learners of each other’s language interact via videoconference in order to complete 
tasks together and help each other with the language learning process in their dual 
expert-novice roles. 

This paper describes the initial findings of participants’ performance and interaction 
analysis in relation to task design in an e-tandem setting. The aim is to explore 
how, and to what extent, different task designs influenced the performance of the 
participants in terms of communication strategies, length of conversation and 
immediate feedback provided during on-task time. The tasks are analysed using 
Robinson’s (2001) Triadic Componential Framework (TCF). The data collected 
are the video recordings of the conversations by eight pairs of learners carrying out 
four different tasks in the tandem MOOC 2014. 


2. Method 

The setting is a six week course with a total of 36 available tasks. Learners could 
opt for the random tandem format in which they were paired up at random or the 
pre-arranged tandem format in which the interlocutor and the task were of their 
choice. Each week had a thematic category for all six activities: Negotiation, 
Quizzes, Free-talk, Problem-solving, Role-playing and Exam Preparation. All 
tasks had an even number of activities in English and Spanish. The tandem 
MOOC platform provided a videoconferencing tool which automatically records 
and archives the conversations, and the tandem tool which distributes the tasks 
to participants in real-time. 

The participant sample is eight dyads, two Learners of English (LoE), B2-C1 
CEFR 3 paired up with five Learners of Spanish (LoS), A2-B1 CEFR. The sample 
was chosen from the participants with the highest number of tasks done in the 
MOOC, in order to ensure a greater number of task samples available for analysis. 

This study is conducted as an ex post facto observation. In order to more accurately 
measure the task effect on participant performance through observation, the same 
four tasks performed by the same two LoE were selected in order to reduce the 
individual differences variables. The task types used in this study, according to 

Pica, Kanagy, and Falodun (1993), are information gap (Quizzes 1), problem- 


3. Common European Framework of Reference 
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solving (Negotiation 1, spot the difference) and opinion exchange (Free-talk 1 and 
Negotiation 6.3). 


The task categorisation was done under the criteria of ‘open-closed’ solution 
and ‘convergent-divergent’ goal. Such variables are part of Robinson’s (2001) 
TCF as interactional task conditions and have been widely studied to determine 
which ones ensure the optimal opportunity for conversational interaction (e.g. 
Duff, 1986; Long, 1981; Pica et al., 1993; Pica, Young, & Doughty, 1987). 
Participants’ performance and interaction are measured by feedback episodes 
such as 1) Explicit Corrective Feedback (ECF), 2) Negotiation of Meaning 
(NoM) and 3) Recast. Feedback episodes are classified into successful and 
unsuccessful. A successful feedback episode indicates that a participant 
noticed the feedback and modified their output or acknowledged the correction 
(Table 1, sample 1). Flowever, if a participant ignored the feedback or failed to 
notice the modified output then the feedback is considered to be unsuccessful 
(Table 1, sample 2). 


Table 1. Feedback excerpts 


Successful feedback - sample 1 

Unsuccessful feedback - sample 2 

P: Can you see fishes? 

O: No I can’t see any fish. 

P: I can see a lot of fish. 

E:/,Esta una pastel o una tarta? 

0:Umm creo que no, no 

E:Ehhh..esta... 

0:En lugar de estar es ser, es; es dulce, no 
es estar, ^,es carne?, ^es verdura?, ^Vale?. 
E:/,Esta un plato famoso en espanol? 


3. Discussion 

According to Pica et al. (1993), Long (1996) and Duff (1986), closed solution 
and convergent goal tasks result in a greater amount and quality of interaction. 
Flowever, in this study, such tasks (Quizzes 1 and Negotiation 1) are the ones with a 
lower number of feedback episodes. In contrast, in this study, the ‘divergent-open’ 
tasks, such as Free-talk 1 and Negotiation 6.3 (opinion exchange) have a longer 
length (Table 2). 


Table 2. Task types and length 


Task 

Total minutes 

Pairs 

Overall time 

Quizzes 1 

42:08 

Pedro - June 

17:44 

Olga - Ellen 

24:24 
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Negotiation 1 

32:10 

Pedro - Oliver 

18:53 

Olga - Garreth 

13:17 

Free-talk 

78:02 

Pedro - Ellen 

51:47 

Olga - Christine 

26:55 

Negotiation 6.3 

42:57 

Pedro - Christine 

18:49 

Olga - Christine 

24:08 


Divergent-open tasks have also a greater number of feedback episodes but 
with a high rate of unsuccessful feedback. Therefore, feedback is less effective 
in contrast to Negotiation 1 (closed-convergent) in which only one out of 
13 feedback episodes was unsuccessful (Table 3). 


Table 3. Feedback episodes per task 


Task 

Total 

ECB 

NoM 

Recast 

Successful 

Unsuccessful 

Quizzes 1 

9 

1 

8 

0 

6 

3 

Negotiation 1 

13 

3 

8 

2 

12 

1 

Free-talk 1 

21 

6 

13 

2 

15 

6 

Negotiation 6.3 

12 

4 

7 

1 

10 

2 


In this study, proficiency and feedback are apparently closely related (Table 4). As 
noted by Kawaguchi and Ma (2012), “[i]t is interesting to observe that the speaker 
of higher proficiency level in all combinations consistently show higher frequencies 
of initiating recasts than the speakers of lower level while this observation is 
reversed with [negotiation of meaning]” (p. 8). In this study, ECF is also notably 
higher among the most proficient learners. 


Table 4. Feedback per participant 


Participants 

Proficiency 

Tasks done 

ECF given 

NoM asked 

Recast given 

Pedro-NSS1 

Cl 

4 

8 

1 

2 

Olga - NSS2 

B2+ 

4 

3 

4 

2 

Christine-NSEl 

B1 

3 

3 

5 

0 

Ellen - NSE2 

A2- 

2 

0 

12 

0 

Oliver - NSE3 

A2+ 

1 

1 

1 

1 

Garreth - NSE4 

A2- 

1 

0 

4 

0 

June - NSE5 

B1 

1 

0 

1 

0 


The most common communication strategies used during negotiation of meaning 
situations are language switch and ask for clarification (see Table 5). This result is 
analyzed in the following section. 
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Table 5. Communication strategies during feedback episodes 


Task 

Participants 

Language switch 

Ask for clarification 

Quizzes 1 

Pedro-June 

1 

0 


Olga-Ellen 

2 

0 

Negotiation 1 

Pedro-Oliver 

2 

1 


Olga-Gareth 

8 (less proficient) 

3 

Free-talk 1 

Pedro-Ellen 

9 (less proficient) 

1 


Olga-Christine 

1 

1 

Negotiation 6.3 

Pedro-Christine 

1 

2 


Olga-Christine 

2 

3 

Total 


26 

11 


4. Conclusion 

Task design and its effect on interaction and negotiation have been studied in different 
contexts in order to provide the most beneficial speaking practice to language learners. 
Several studies have confirmed that learners can develop their language competence 
through negotiation of meaning, which promotes the elicitation of modified input and 
output, enhances learners’ comprehension and draws their attention to L2 form as 
well as meaning (Gass & Varonis, 1985, 1994; Long, 1996; Pica, Young, & Doughty, 
1987). The results in this study have to be interpreted tentatively due to the small 
size of the sample, the video recording selection criteria based solely on the most 
active participants and the variety of tasks. Having said that, the results suggest that 
we cannot assume that learner performance in a tandem setting will be the same as 
in the Non-Native Speaker (NNS)-NNS, or novice-expert dyad configurations found 
in most studies in the literature of TBLT. For instance, the presence of a very high 
number of language switching episodes in a Native Speaker (NS)-NNS interaction 
(presented in Table 4) reflects the peculiarity of interaction in tandem settings, as 
learners know each other’s language. The possibility that differences may be due 
to the interaction setting of a tandem conversation means that studies need to be 
replicated in this particular design before transferring any results. We plan to extend 
this study further by collecting a larger sample of data and complementing this with 
participant interviews in the next edition of the tandem MOOC in the fall of 2016. 
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Abstract. In an attempt to understand whether Mobile-Assisted Language 
Learning (MALL) could foster students’ self-directed learning, this paper analyzes 
a self-directed learning experience by means of a language app: Duolingo. In 
this study, higher education language students were encouraged to use Duolingo 
outside of the classroom. The data collected via app tracking, surveys and semi- 
structured interviews reveal that the low activity in the app contrasts the high 
value students attribute to it. Students indicated that the low activity is due to other 
obligations in their lives. They also expressed the need of external motivation to 
finish the course. The study suggests that mentoring and modeling are still needed 
in the development of self-directed study skills and it highlights the importance 
of implementing different data collection techniques to understand what students 
think and do in MALL. 

Keywords: data collection, Duolingo, MALL, self-directed study. 


1. introduction 

When inquiring about what students do in a computer assisted language learning 
environment, Stockwell (2012) hints at an over reliance on surveys as a data 
collection method. Likewise, Fisher (2012) states that the “use of questionnaires 
alone is not a reliable source of information about student use of software and 
should be avoided as a single source of information” (p. 27). The ubiquity and 
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just in time learning provided by MALL have particular implications on how 
users self-direct their learning and how researchers collect data on students’ 
activity. Stockwell (2013) points out the small “amount of research examining 
how learners engage in mobile learning outside of the classroom” (p. 118). Little 
is known about what happens when students download a language application to 
their devices. 

Conveniently, MALL applications are gradually adding features that allow 
quantitative measurements of app usage. One example is the free of charge 
application Duolingo. Through its unobtrusive tracking dashboard Duolingo for 
schools, teachers can see the languages students are practicing and their progress 
in the Duolingo language curriculum. 


2. Method 

The participants were Colombian higher education students enrolled at different 
levels of language courses. 574 students were given a formal lecture about 
Duolingo. They learned about its different features and they were encouraged 
to use the app at their convenience. Furthermore, students were invited to join 
the Duolingo dashboard where their activity would be tracked. 273 students 
reported to not have used Duolingo; 149 students reported having used Duolingo 
after the MALL lecture while 118 of these users accepted to be tracked in the 
dashboard. 

Eight weeks after the lecture in which they were encouraged to use the app, students 
filled out a questionnaire on their perception of Duolingo. The questionnaire 
contained items measured through a Likert scale where 1 represented totally 
disagree and 5 represented totally agree. 

Once a year had passed, students’ data from the dashboard were retrieved. A 
stratified sampling was applied to select students for an interview about their 
general impressions of the app and their opinion about how to foster its use 
among the student population. The analysis of the sampling population resulted 
in the stratification of the data into three groups of students: tracked students who 
barely used Duolingo (students who were active ten days or less, N=73), students 
who had a moderate use (students who were active more than ten and less than 
50 days, N=31) and students who had the most sustained use (students that were 
active 50 or more days, N=14). Five students in each group were randomly 
selected for the interview. 
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3. Results 


Table 1. Questionnaire: students’perceptions about Duolingo 


Duolingo item sorted from high to low score. 

N=149 

Mean 

SD 

1. Duolingo encourages me to learn different languages 
that are not taught in the Modem Languages program 

3.97 

0.993 

2.1 would like Duolingo to be integrated as a component of 
independent learning (work done outside the classroom) 

3.94 

0.91 

3.1 like the game-like methodology proposed by Duolingo 

3.93 

0.844 

4. Duolingo allows me to be independent in language learning 

3.93 

0.844 

5.1 have no problem to access Duolingo 

3.93 

1.101 

6.1 would recommend Duolingo for language learning 

3.91 

0.932 

7.1 find a connection between what I studied in Duolingo 
and what was taught to me by the language teachers 

3.89 

0.927 

8.1 think I can improve my vocabulary with Duolingo 

3.89 

0.934 

9.1 think Duolingo offers an organized language learning path 

3.87 

0.935 

10. Duolingo is fun for people my age 

3.87 

0.903 

11.1 like the exercises proposed by Duolingo 

3.86 

0.923 

12. Duolingo motivates me to study languages 
with my Smartphone or tablet 

3.85 

0.964 

13.1 think I can improve my grammar with Duolingo 

3.83 

0.918 

14.1 think that I can improve my listening with Duolingo 

3.81 

0.896 

15.1 think I can improve my writing with Duolingo 

3.79 

0.903 

16.1 think that I can improve my speaking with Duolingo 

3.72 

0.958 

17.1 think Duolingo can satisfy my learning needs 

3.72 

0.985 

18.1 would like my teacher to see my progress in Duolingo 

3.71 

1.009 

19. Duolingo encourages me to go beyond what 
is taught in the language classroom 

3.70 

0.991 

20.1 think I can improve my reading with Duolingo 

3.68 

0.939 

21.1 would like Duolingo to be integrated inside the classroom 

3.58 

0.952 

22.1 prefer other free apps to learn languages than Duolingo 

3.38 

0.977 


Table 2. Duolingo dashboard: average of completed units and number of days 
of Duolingo use 


N= 118 

Mode 

Range 

Mean 

SD 

SE 

Days Active 

1 

0- 394 

15.13 

45.18 

3.06 

Lessons completed 

0 

1908 

56.49 

169.95 

11.53 

Units completed* 

0 

78 

13.55 

18.47 

1.25 


* A unit is a set of lessons 
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Table 3. Course completion: verall language course completion in Duolingo 


Course Group 

N. 

N. Students 
who finished 
the course 

Language completed 

English semester 1 

17 

1 

English 

English semester 2 

18 

1 

English 

English semester 3 

13 

3 

English 

English semester 4 

20 

2 

English 

French semester 1 

8 

0 

- 

French semester 2 

10 

0 

- 

French semester 3 

14 

2 

1 English 

1 French 

French semester 4 

18 

3 

3 French 

1 Italian* 

Total 

118 

12 

8 English 

4 French 

1 Italian* 


*Same student did French and Italian 


4. Discussion 

According to the students’ questionnaire answers, Duolingo is perceived to 
be a useful tool for language learning. Views of Duolingo are positive as an 
instructional method (items 3, 7, 9, 11), motivation tool (items 1, 10, 11), 
promoter of self-directed learning (items 2, 4) and enabler of language skills 
practice items (8, 13-16, 20). These results were confirmed by the individual 
semi-structured interviews in which every interviewed student reported 
having recommended the app to peers and friends (as predicted in item 6 of 
the questionnaire). However, the results retrieved from the Duolingo dashboard 
reveal that only 12 out of the 118 tracked students (10%) managed to completely 
finish a Duolingo language course. Despite the considerable variability of the 
data, Table 2 puts into evidence the low participation of students. Different data 
collection techniques reveal a discrepancy between students’ perception and 
actual use of the application. Such discrepancy is seen in similar studies (e.g. 
Stockwell, 2008). From the students’ point of view, this is explained by their 
busy lives inside and outside their academic context, the lack of formal follow¬ 
up (related to the absence of a teacher), and the lack of additional motivational 
factors (e.g. language certificate, course grades). Our results confirm studies that 
take into account the relationship between students and technology (e.g. Azevedo 
et ah, 2003) in which the difficulty of learners to self-regulate when learning is 
demonstrated. 
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5. Conclusion 

This study points out the relevance of data collection to improve the understanding 
of MALL outside formal educational contexts. Although tracking is not the panacea 
in computer-assisted language learning research to investigate student behavior 
(Fischer, 2007), it demonstrates the relevance of scrutinizing actual usage data 
because what learners indicate in surveys contradicts what they do in reality. 

The combination of data collection techniques suggests that self-directed 
learning in MALL requires modeling and mentoring, which is why a tutor (such 
as a teacher) remains important. Even if students are formally introduced to an 
expectedly convenient and motivating app, only a small number of them make 
substantial extracurricular use of it. Residts of the study show that for substantial 
MALL usage, a combination of incentives, scaffolding and curricular integration 
are needed. Such concepts will be investigated in follow up studies. 
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Abstract. This research focuses on the design of resources for both reappraising the 
knowledge of a native language for those who speak or have notions of Nahuatl, 
and getting familiar with terms for those who do not speak this language. An 
audio-lexicon Spanish-Nahuatl, ALEN, was developed taking advantage of new 
technologies, especially mobile devices and gadgets, as an opportunity to reach 
children and youth mainly. A beta version of ALEN has been tested by volunteers 
with very promising results. Examinations of knowledge of Nahuatl language before 
and after one week of use of ALEN have shown that most volunteers improved their 
vocabulary. 

Keywords: native language learning, endangered languages, mobile devices. 


1. Introduction 

Nahuatl is a Native American language with the largest population of speakers in 
Mexico, nearly 1.5 million people - that represents 1.7% of the total population 
over five years (INEGI, 2000) - speak Nahuatl. As mentioned by Monzon (1990), 
“Nahuatl is the result of a continuous and long history of communication creativity” 
(p. 11). It was the dominant language in the center of Mexico before the Spanish 
conquest by the mid-fourteenth century. Nowadays Nahuatl is mainly spoken by 
marginalised groups. 
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Diverse efforts are made around the world to preserve and disseminate endangered 
languages, since languages have a major role in the cultural heritage of mankind. 
For instance, the declaration of an International Mother Language Day by the 
United Nations Educational, Scientific and Cultural Organization (UNESCO), 
whose goal is to encourage linguistic and cultural diversity in the world and raise 
awareness about the 3,000 of the 6,000 languages spoken in the world that are 
endangered to a greater or lesser degree (UNESCO, 1999). 

There are different ways to contribute to safeguarding endangered languages; from 
the promulgation of public policies and laws to preserve and promote minority 
languages to the generation of linguistic resources oriented to these minorities. This 
research deals with the latter effort, the design of resources for both, reappraising 
the knowledge of a native language for those who speak or have notions of Nahuatl, 
and getting familiar with Nahuatl terms for those who do not speak it. 

Since this research aims to reach children, teenagers, and young adults, Nahuatl 
resources are developed taldng advantage of new technologies, especially mobile 
devices and gadgets. For that, an Android based application called ALEN (from its 
Spanish acronym that means Audio-Lexicon Spanish-Nahuatl) has been developed 
and tested. ALEN comprises a database of 132 words in Spanish and Nahuatl, 
with both written and oral modalities, homemade illustrations and word-search 
capabilities. 

As a preliminary step for testing with the intended users, a beta version of ALEN has 
been tested by volunteers, with aim of fine tuning it. These volunteers completed 
a Nahuatl knowledge examination twice, before and after the testing period. 
Volunteers also completed a test which revealed that the preliminary version of 
ALEN was useful to get familiar with Nahuatl notions. 


2. The Audio-Lexicon Spanish-Nahuatl 

The application was created using Android Studio, the official IDE for mobile 
application development based on IntelliJ IDEA 4 . Overall, the ALEN application 
runs locally and once installed, it does not create files or require access to services 
and resources such as the phone network, WiFi or Bluetooth connectivity. There 
are more than twenty Nahuatl variants in Mexico, but the variant with the largest 


4. Android Studio and SDK, https://developer.android.com/intl/es/sdk/index.html 


156 





An Audio-Lexicon Spanish-Nahuatl... 


number of speakers is that of the north of Veracruz. This is the Nahuatl variant 
included in the project. 

2.1. Android app 

The ALEN application has a simple interface, which allows the user to enter text 
in Nahuatl or Spanish. There are two buttons, one used to find the written word in 
the text box and the other to reproduce the pronunciation of the word when found. 
At the center of the screen, an image illustrating the concept related to the word is 
displayed. Figure 1 shows the interface of the application running on a cell phone 
and a tablet. 

Figure 1. ALEN interface in two devices 



2.2. Experimental settings and analysis results 

One dimension of the ALEN application was evaluated: how useful it is for 
reinforcing and acquiring vocabulary of the Nahuatl language. The procedure 
completed by the volunteers that participated in the study was as follows: (1) 
creating an access account on the website of ALEN; (2) completing an initial 
examination of knowledge of Nahuatl language; (3) installing the application on 
their mobile devices; (4) using the application as many times as possible during 
one week; and (5) completing a second examination of knowledge of the language. 

The online examination of knowledge of Nahuatl language was specially designed 
for this study. Nahuatl being a native Mexican language, it has been in constant 
contact with Spanish, the language commonly spoken in Mexico. For that, 
Mexicans are familiar with some Nahuatl words and it is important to measure any 
notion of Nahuatl that our volunteers might have. 
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The examination of knowledge of Nahuatl comprised 15 questions. The first ten 
were aimed to achieve word pair association; in the first column Nahuatl words 
were listed, and in a second column Spanish words were presented, sorted in a 
different order. The latter five questions were intended to assess listening skills. 
Each question included an audio recording of a native Nahuatl speaker, and a 
window for writing the word heard by the user. Volunteers received one point for 
each question properly answered and there were no time constraints to complete 
the examination. The set of 132 words within ALEN was used as the battery for 
randomly generating the examinations of knowledge of the language. 

2.3. Participants 

A total of 11 volunteers participated in the evaluation of the beta version of ALEN, 
nine men and two women, of ages 29.6 ± 7.3 years. All the volunteers were native 
Spanish speakers. They gave their informed consent to participate in the study. 


3. Results 

Figure 2 depicts the comparison of number of points scored by volunteers in the first 
and second examination of knowledge of Nahuatl. Note that most users achieved 
clear improvement in their Nahuatl vocabulary after one week using the mobile 
application. In effect, 82% of volunteers improved their knowledge of Nahuatl. 
This result might also be related to the frequency of use of the application, with 
73% of volunteers reporting the highest values of use frequency, i.e. between ten to 
30 times, meaning they used ALEN at least once every day, on average. 

Figure 2. Points scored by volunteers in first and second examination 
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4. Conclusions 

The goal of this research is to contribute to safeguarding endangered languages, 
namely the Nahuatl language, by developing tools and resources for their 
preservation and dissemination. Also, we look to develop these resources by taking 
advantage of the capabilities of mobile devices that are especially popular among 
young people. 

We have described the design of the ALEN application, an Audio-Lexicon Spanish- 
Nahuatl whose beta version has been evaluated by 11 volunteers with encouraging 
results in terms of scores of improvement of vocabidary. Most volunteer users of 
the ALEN application improved their Nahuatl vocabulary, and also most of them 
frequently used the application during the test period. 

In the near future, we will extend ALEN with an option for a spoken search to 
improve user interaction. This extension requires the processing of audio inputs, 
as well as the extraction of relevant features to be compared with pre-processed 
models of those words in the lexicon. We will also increase the set of words of the 
application, and finally we will include other variants of Nahuatl. 
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The use of interactive whiteboards: enhancing 
the nature of teaching young language learners 

Christina Nicole Giannikas 1 


Abstract. Language teaching can be enhanced by effective uses of technology; 
nonetheless, there are teachers who are reluctant to integrate technology in their 
practice. The debated issue has resulted in a number of Ministries of Education 
worldwide, including the Greek Ministry, to support a transition through the 
introduction of Interactive Whiteboards (IWBs). This initiative was not well- 
received in either the public or private sector, due to the fact that teachers were 
not provided with any training in how to use IWBs and include them in their 
teaching. IWBs became intimidating to the language teacher and did not serve 
their intended purpose in most cases. Nonetheless, there were teachers who were 
intrigued by IWBs and made an effort to apply them. The present paper focuses on 
the development of interactive language learning and the effect the teachers’ risk¬ 
taking has on pedagogy from the teachers’ and students’ perspectives. The outcomes 
of the study were that language teachers have taken charge of their own professional 
growth and take risks in order to help learners benefit from IWBs. However, due to 
lack of training, teachers and students have not reached the zenith of using IWBs. 

Keywords: interactive whiteboards, young learners, teaching practices, teachers’ 
risk-taking. 


1. Introduction 

Language teaching can be enhanced by effective uses of educational technology; 
nonetheless, there are language teachers around the globe who are reluctant 
to integrate technology in their practice (Papadima-Sophocleous, Kakouli- 
Constantinou, & Giannikas, 2015). 
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The issue has been highly debated in the field and measures have been employed 
to support the integration of technology in education, including financial support 
(DfES, 2003, 2005). Such a transition was supported by the Greek Ministry of 
Education through the introduction of lWBs. The Ministry of Education, with the 
support of MLS, a Greek leading company in educational technology, supplied 
and installed 3,300 IWBs in public schools across the country (http://www.skai.gr/ 
news/technology/article/169271/diadrastikoi-pinakes-sta-ellinika-sholeia-/). This 
initiative inspired private language school owners to supply their teachers with 
IWBs as well. Due to a lack of training, this innovative and powerful technological 
tool was intimidating in the eye of the language teacher, and did not serve the 
purpose it was meant to in most cases. However, there were teachers who were 
intrigued by IWBs and made an effort to apply its use in their classes. These 
teachers were self-taught and their motivation led them into making an effort to 
train their peers in the process. 

The present paper focuses on the self-taught language educators in question, 
specifically on teachers of young language learners. The effect and development of 
interactive language learning in a context where no training was undertaken will 
be discussed; additionally, the effect the teachers’ risk-taking has on pedagogy are 
presented. The paper introduces a small-scale study with a focus on young learners. 


2. Method 

2.1. Research methods and data analysis 

The current exploratory study aimed to record the use of IWBs in the young 
learners’ classroom. The study took place in South Western Greece and focused 
on private language schools. For the needs of the present small-scale study, data 
was collected through semi-structured interviews with five language teachers, and 
through questionnaires completed by 50 students. ATLAS.ti 7©2013 was used 
to analyse and code the interview recordings. The procedure was carried out as 
follows (inspired by Giannikas, 2013): 

• An initial reading of the transcribed interviews was conducted. This 
process allowed themes to emerge. 

• The texts were re-read and thoughts were annotated in the margin. The text 
was examined closely to facilitate a micro-analysis of data. 
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The data from all the questionnaires were transferred onto a spreadsheet and 
calculated on Excel. 

2.2. Research participants and context 

The study focused on young learners, aged nine to 16, who attended private 
language lessons after mainstream school. The teachers who participated were 
from the same language school and had been teaching languages for six to 25 years 
and four out of five held an MA in English Literature and Languages. According 
to the interviews conducted, four out of five teachers had been using IWBs for 
three to four years and one had been using it for one year. None of the teachers 
had official training on how to apply IWBs. They were self-taught and exchanged 
information regarding the use of IWBs and their features with colleagues. 


3. Discussion 


Although using a PC and the Internet are a daily occurrence, integrating and 
mastering Information and Communications Technology (ICT) in language 
teaching is not a simple task, especially when no training is involved. According to 
interview data, all teachers claimed that IWBs had the potential to add benefits to 
their teaching and prompt them into becoming better pedagogists. The following 
figures (Figure 1, Figure 2, and Figure 3) indicate the teachers’ efforts in using 
IWBs frequently. 

Language teachers in this context have been experiencing radical transformations 
in their classroom environments and have been willing to take risks and expose 
their lack of training in the use of IWBs in order to offer as much as possible 
to their students. Teachers of the Greek context have been deprived of essential 
technical and practical guidance that would make the use of IWBs more effective. 


Figure 1. For how many years have you been using IWBs? 



Teacher 1 Teacher 2 Teacher 3 Teacher 4 Teacher 5 


162 














The use of interactive whiteboards... 


Figure 2. How many times a week do you use IWBs? 
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Teacherl Teacher 2 Teacher 3 Teacher 4 Teacher 5 


Figure 3. How long do you use IWBs in each lesson (in minutes)? 
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One point that was made during interviews was that three out of five teachers used 
the 1WB more than their students did in class. More specifically, sample statements 
of what teachers liked least about IWBs are as follows: 

“I dislike the fact that the children cannot use the 1WB as much as I do” 

(Teacher 1). 

“It requires more teaching time” (Teacher 4). 

An interesting outcome of the research was that the younger teachers, who have 
been more exposed to technology and software, were of the impression that the IWB 
was mainly a tool used by the teacher rather than the students. This means that even 
though the IWB encourages student-centred learning, there are teachers who apply 
it in a teacher-centred environment due to their lack of training and/or reluctance to 
step out of their teacher-fronted comfort zone. The older teachers stepped back and 
gave students the opportunity to use IWBs more and become independent users. 
The teachers who embraced the student-centred environment with the help of IWBs 
were recorded to play more interactive games on the IWB than the younger teachers, 
whilst the teachers who supported a more teacher-fronted environment embraced 
more grammar and vocabulary tasks and avoided interactive activities. 
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These findings are in agreement with the outcomes from students’ questionnaires 
as indicated in Figure 4. 

Figure 4. Flow often do you play games on the IWB? 



The open-ended question of what the students’ favourite task on the IWB was 
retrieved the following sample quotes (translated from students’ LI): 

“Games where we learn grammar” (Student 22). 

“My favourite activities are crosswords” (Students 13). 

“1 like playing Hangman” (Student 34). 

“I like listening activities on the IWB because I can concentrate better 
having pictures to look at” (Student 44). 

“1 like fill-in the gaps activities” (Student 12). 

“1 like multiple-choice activities” (Student 4). 

The students’ responses show that students appreciate the interactive nature of the 
IWB and the variety it offers. The IWB has a lot to offer and the questionnaires 
indicate that the features of an IWB triggers all kinds of language learners. The 
tasks the students completed on the IWB enhance their involvement, and the 
hands-on tasks can give them autonomy and facilitate multisensory learning, which 
is evident in the students’ selection of preferable tasks. 
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4. Conclusions 

Students’ increased engagement is the main benefit of using IWBs, and this has 
been realised by the participant teachers who have integrated IWBs, despite the fact 
that they have not been officially trained to do so. They make an effort to include 
IWBs as often as possible in a context they can control and function. Although 
this may deprive them and their students of some of the interesting features IWBs 
have to offer, they apply the tool as much as they can. Nonetheless, teachers chose 
to adopt a teacher-centred environment with the use of IWBs. Had teachers been 
offered official technical and practical training when IWBs were introduced to the 
Greek education system, their approach would be different, given their openness 
to learning new features to language teaching and to taking risks in the classroom. 

The study conducted supports that instruction with the use of IWBs can be 
well-received by young learners. Learners become involved and can adapt to 
the technological tool presented to them. It gives them many opportunities to 
evolve as learners and users of technology. Since IWBs already exist in most 
educational contexts, whether in the private or public sector, training ought to be 
offered to all teachers in order to enhance professional development, which will 
have an immediate effect on young language learners. Additionally, teachers can 
become more comfortable with IWB technology, being more exposed to effective 
pedagogical practices and teaching strategies. 

The present study shows that there is potential in language learning for children 
with the use of IWBs, due to the teachers’ willingness to integrate new technology 
and take risks when applying it. This attitude is a positive first step and if the correct 
measures are taken from policy makers and stakeholders, language teaching may 
advance in extraordinary ways, in the region and beyond. 
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international students at the University of Padua 

Lisa Griggio 1 and Edit Rozsavolgyi 2 



Abstract. This study focuses on a strategic partnership with students from the 
University of Padua and international students coming to Padua mainly in the 
setting of Erasmus student mobility and exchange programs. The project is designed 
specifically for incoming international students to facilitate their integration into the 
Italian higher educational learning environment. They can practice their Italian, have 
practical infonnation about Padua and its university, and get to know local students 
with whom they can possibly have face-to-face relationships after their arrival. The 
online exchange - based on the principles of tandem learning - is carried out in the 
setting of a one-to-one and a many-to-many interaction using different technological 
tools which include a dedicated institutional Moodle platform, a social Facebook 
area restricted to the eTandem community and other networking systems such 
as Skype, e-mail, chat and WhatsApp. We have found that the project helps both 
Italian and international students develop their digital, linguistic and intercultural 
competencies, boosts their critical thinking and cultivates their curiosity towards 
others. It facilitates international students’ integration into their target country/ 
university/culture. 

Keywords: eTandem, pre-mobility, university students, international setting. 


1. introduction 

New learning policies promote plurilingualism, internationalization, learner 
autonomy for lifelong learning and require the aptitude of young people to deal 
competently with the demands of linguistic and cultural diversity. To this aim, we 
have to rethink traditional notions and priorities of language education. 
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Numerous educators and researchers have noted that the use of information and 
communication technologies in L2 teaching/acquisition seems to be the best way 
to cope with the challenge of internationally changing educational scenarios force 
upon us (e.g. Pareja-Lora, Rodriguez-Arancon, & Calle-Martinez, 2016). 

It has always been an uncontroversial assumption that one of the most effective 
ways of improving L2 communication skills is through enabling students to 
engage directly with native speakers. The potential of tandem interaction in online 
environments is self-evident. But technology itself is only a means to an end, and 
the actual application of Web 2.0 tools to exploit distant peer-to-peer activities for 
educational purposes is far from being simple and easy. Attractive and effective 
foreign language learning calls for an organized and structured framework 
which can give students the support they need in order to make the most of the 
opportunities that the wide variety of communicative channels they have at hand 
presents. 

In this study we want to exchange good practices by providing the outcomes of 
an eTandem project carried out at the Padua University Language Center during 
the winter of the 2015-2016 academic year. The project welcomed Italian students 
from Padua University and international students that in the framework of student 
mobility programs such as Erasmus were coming to Padua for the spring term of 
the same academic year. 

Our approach was plurilingual, intercultural, inclusive and attentive to the basic 
e-skills which 21st century students need, i.e. strategies for effective online 
activities, ability to evaluate and use online sources of information, ability to use 
Internet applications for effective cooperation and collaboration (Dede, 2009; 
Fullan, 2013; Griffin, McGaw, & Care, 2012; Klimczak-Pawlak, 2014). The 
objectives of the project were as such manifold: 

• deepening students’ linguistic competence via content-related input; 

• promoting their ability to perceive and mediate the relationships which 
exist among languages and cultures; 

• supporting respect for the plurilingualism of others and the value of 
languages and varieties irrespective of their perceived social status; 

• upholding respect for the cultures embodied in languages and the cultural 
identities of others. 
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Through the participation in this international cooperation project we wanted all 
students to enjoy multilingualism and not be afraid of it. Following the European 
educational priorities, key competences for lifelong learning (Europa, 2006) were 
in the forefront for better learning outcomes. By establishing a community-based 
learning via Facebook and by interacting and negotiating with their eTandem 
partners when it came to one-to-one interaction, students were engaged in 
meaningful communicative activities relevant to real life situations and it turned 
out to be creative as well as interesting for them. 


2. Description of the project 

In the pre-mobility eTandem project, 78 Erasmus students and 51 Italians enrolled. 
Because of the different number of participants between the two groups, not only 
dyads but some triads were formed as well. The project took place prior to the 
arrival of international students to Padua and lasted eight to ten weeks. It worked as 
a preparatory activity to their departure, boosting both their linguistic competence 
and a better insight into the culture of the host country and supported personal 
motivation for their Erasmus program. 

As most online exchanges, our project aimed to promote autonomy and reciprocity 
(Vassallo & Telles, 2006) in a real life language context through communication 
with native speakers of the target language and aspired to stimulate a deeper 
understanding of students’ own as well as their peers’ culture. Yet, our exchange 
offered the participants a double line of interaction: a one-to-one and a many-to- 
many communication mode. Besides the individual tandem in the target language 
with their partners, students could join our eTandem community in Facebook 
where different intercultural topics, either in Italian or in English used as lingua 
franca, were discussed. This social area implied an exchange on a wider basis: 
not only did it serve to put all participants in touch so that they could experience 
an enriching multilingual and multicultural context, but it also prevented students 
from dropping the exchange by creating group cohesion. 

In the first week, students entered two different platforms, Moodle and Facebook. 
In the institutional Moodle area one was able to learn how to move the first steps in 
the eTandem setting and to browse some resources to support one’s linguistic, digital 
and cultural knowledge. The project also included some theme-based asynchronous 
activities in Facebook on a weekly basis. Tutors proposed and moderated debates 
on both neutral/safe topics, like reading, traditions, food, etc., and controversial 
issues such as animal experimentation, legalization of soft drugs, promoting critical 
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thinking, critical literacies and reflexivity. Any argument introduced in the social 
community environment could be dealt with in the individual interaction setting. 

After each discussion, students were encouraged to write a diary. This type of 
activity served as a tool to reflect on and evaluate thoughts, ideas, feelings and 
students’ own learning process closely following and recording their progress. The 
‘writing space’ contributed to a growing self-awareness of students in their role of 
learners, but also helped tutors to have their fingers on the pulse of opinions and 
feelings of the eTandem community pennitting a continuous adjustment of the 
project to students’ needs, competences and suggestions. 


3. Analysis of the outcomes and conclusion 

Our analysis is based on two sources: (1) feedback questionnaire outcomes and 
(2) the observation of the 129 participants’ activity in Facebook and in Moodle. 
At the end of the project students were asked to fill in a feedback questionnaire in 
order to reflect on their linguistic, digital and social learning outcomes. Out of 129 
participants, only 22 responded. 

The online questionnaire was composed of 28 items and students accessed it from 
the eTandem Moodle platform. The great majority of the questions was closed but 
in some cases students were given the opportunity to express themselves freely. 
We wanted to know about students’ eTandem management and we were curious 
to know if they devoted any time to corrections and if so how they delivered it. 
The second part of the questionnaire dealt with students’ opinion about the project 
and students’ assessment. We asked if they think their own and their partner’s 
knowledge of language improved or was useful for them and in which areas, if 
they got on well with their partner(s), and if they found it useful to write diaries. 
Further, we investigated the topics we proposed in the e-community and which 
topic(s) they preferred, if they used the language resources provided in Moodle, if 
they would have preferred more assistance and more structured activities, if they 
were going to keep in touch with their partner(s) once in Padova and if after this 
experience they felt more confident about going abroad in the setting of a student 
mobility. We also asked for a global assessment of students’ eTandem experience 
and for any suggestions to give us in order to improve the project. 

Data analysis indicates that the majority of students (72%) found Facebook to be 
the most useful tool for interacting and used WhatsApp and e-mail equally (45%). 
Skype was employed by few people (36%) because of different time zones. 
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It emerged that all but two people considered the project very or quite useful. 21 
participants declared to be willing to stay in contact with their eTandem partner 
once he/she is in Padua and 17 Italian students stated to be more convinced to apply 
for an Erasmus scholarship after this experience. 

The project brought benefits to the participants. Technologically speaking, students 
learnt how to use Moodle and Facebook, how to search and retrieve information 
from the web, how to use the net and social networks in a more responsible way 
defending their web reputation. Linguistically, they developed informal lexicon and 
written and oral skills both in English/Italian used as lingua franca and their target 
language. Participants became more competent in social skills such as commenting, 
sharing and interacting online, but also active listening, understanding diversity 
and respect for differences. All students reflected on and learnt about their own as 
well as other’s culture while international students felt more integrated in the host 
campus. 
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Abstract. This study examines the development of oral fluency in a Computer- 
Mediated Communication (CMC) environment that uses a ‘shouting’ digital game 
as a pedagogical tool: Spaceteam ESL 4 . Spaceteam ESL is a game for mobile devices 
that involves time-sensitive aural exchanges among players (English learners), with 
great potential to promote fluency development (via speed) in a non-threatening 
environment (mediated by the game, a CMC tool). 20 high-beginner/low-intermediate 
English as a Second Language (ESL) learners participated in the study, divided into 
two groups: an experimental group (n=ll), which played the game for 15 minutes 
as a warm-up in class for a period of six weeks, and the control group (n=9), which 
was engaged in ‘traditional’ classroom activities such as info gap, story retelling, and 
other interactive activities for the same period of time. The study followed a mixed- 
methods design with pre-, post-, and delayed post-tests to measure developments in 
oral fluency (measured via the computation of number of syllables per second). The 
results suggest that mobile games such as Spaceteam ESL have the potential to assist 
in fluency development, but further investigation is needed. 

Keywords: MALL, digital gaming, fluency development. 


1. Introduction 

Fluency development, which refers to the automatization or fluidity of speech 
(Derwing, Munro, Thomson, & Rossiter, 2009), is largely concerned with the 
temporal aspects of speech. According to Nation and Newton (2008), encouraging 
fluency development “is important at all levels of proficiency” (p. x). Unfortunately, 
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because these activities do not encourage the acquisition of new language items 
but rather focus on practicing known items, they are often not addressed in the 
classroom due to time constraints (Nation & Newton, 2008). Anxiety and/or 
a low level of Willingness To Communicate (WTC), which often limits output 
production (Gregersen & MacIntyre, 2014), may further reduce chances for fluency 
development (Horwitz, Horwitz, & Cope, 1986). 

The current study proposes the use of Spaceteam ESL, a free mobile game available 
on Android and iOS as a fluency development activity, and investigates its effect on 
fluency development. Developed by David Waddington and Walcir Cardoso, and 
based on the original Spaceteam mobile game created by Henry Smith of Sleeping 
Beast Games (SleepingBeastGames.com), Spaceteam ESL is an interactive digital 
game for mobile devices. In teams of two to four, players must engage in real-time 
computer-mediated interaction with other players to navigate a spaceship. Each 
player is presented with a unique panel of buttons and dials (labelled with randomly 
generated noun-verb-adjective combinations based on vocabulary frequency bands); 
time-sensitive orders also appear on-screen. Players must give orders to one another 
by reading them aloud (intelligibly) from their panels while simultaneously receiving 
(via listening) and interpreting commands to manipulate buttons and dials on their 
own panels. Players have a limited amount of time to communicate these instructions 
and/or carry them out (see Figure 1 for the game interface). 

Figure 1. Spaceteam ESL interface, as demonstrated on the panels of two players 
from the same team 
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Spaceteam ESL fulfils Nation and Newton’s (2008) requirements of fluency 
development activities: it encourages players to speed up the use of language items 
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(e.g. previously acquired vocabulary, phonological features such as segments) 
and to process a large amount of input in order to understand the interlocutor’s 
intended meaning in an efficient, fluent manner. Results of a pilot study (Cardoso, 
Grimshaw, & Waddington, 2015) suggest that Spaceteam ESL may also reduce 
anxiety and increase WTC in learners, while encouraging higher levels of oral 
output. The current study focuses its attention on the development of the temporal 
aspects of oral fluency, such as rate of speech and pause length (operationalized 
here as the number of syllables a person produces per minute), as these features 
relate closely to Derwing et al.’s (2009) definition of fluency. Accordingly, the 
study asked the following research question: Does playing Spaceteam ESL affect 
fluency development in second language learners? 


2. Method 

20 students from two high-beginner ESL classes (B1-B2 based on the Common 
European Framework of Reference for languages) at a French-language college 
in Canada participated in the study. One class acted as the experimental group 
(n=ll), which played the game for 15 minutes as a warm-up in class for a period 
of 6 weeks (the treatment), and the other acted as the control group (n—9), which 
engaged in ‘traditional’ but interactive classroom activities such as info gap for the 
same period of time. 

Quantitative data were collected for all participants from the pre-, post-, and 
delayed post-tests. For each test, participants were recorded telling a short story 
about their summer vacation. Syllables Per Minute (SPM) were calculated from 
the recording samples collected from the participants. 


3. Results 

A repeated measures factorial design test was conducted to measure the difference 
between the treatment and control groups from pretest to two post-tests, in which 
the independent variable was the treatment and the dependent variable was SPM, 
the measure of oral fluency adopted. Results indicate that there was no significant 
difference in improvement between groups over time (Table 1), p=395. 

Paired-samples t-tests were also conducted, one for the treatment group and one for 
the control group. Overall, the treatment group increased their fluency performance 
from the pre-test (M= 108.27, ££=8.36) to the post-test (M= 111.09, ££=8.76). 
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However, this difference, -2.82, BCa 95% Cl [-17.64, 12.01], was not significant 
f(10)=-.42, y?=68, and represented a small-sized effect, >=0.13. The control group, 
on the other hand, decreased in performance from the pre-test (M= 112.67, S/T= 10.21) 
to the post-test (M=101.78, SE=1 .71). As was the case with the experimental group, 
this difference, 10.89, BCa 95% Cl [-4.71,26.48], was also found to be not significant 
r(8)=1.61,jr>=.146, but represented a medium effect size of >=0.5. 


Table 1. SPM for storytelling task 


Group 

Pre-test 

Post-test 

Delayed Post-test 


M 

SD 

M 

SD 

M 

SD 

Treatment 

108.27 

127.72 

111.09 

27.71 

120.27 

25.82 

Control 

112.67 

30.63 

101.78 

23.13 

123.78 

29.59 


While the results indicate that there was no significant difference in fluency 
improvement between the treatment and control group between the three tests, they 
do show a trend in the data. This trend suggests that although there was no significant 
improvement over time, the treatment group did appear to improve slightly between 
the pre- and post-tests, whereas the control group decreased in performance between 
these same tests. Participants in the treatment group continued to improve through 
the delayed post-test; the control group, interestingly, also improved from pre-test to 
delayed post-test, despite their decline in performance at the post-test. A limitation 
in the study may explain these results: participants had a one-week break between 
treatment weeks five and six. Week 6 was the final treatment session and participants 
had a class evaluation that same day; the post-test was also conducted during this 
session. Participants therefore had not practiced English for two weeks and were 
distracted by their evaluation. We acknowledge that this may have had an impact on 
their fluency (SPM) scores. Despite this, the treatment group continued to show a 
trend of improvement over the inconsistent results observed for the control group at 
the post-test. This may suggest that the use of Spaceteam ESL as a warm-up activity 
was a more effective ‘refresher’ for English after vacation than the activity the 
control group engaged in. The control group may have instead required more time 
and exposure to English to perform at their normal level. 


4. Conclusions 

The study investigated the effects of playing the mobile teambuilding game 
Spaceteam ESL on fluency development and found that there was no significant 
difference between the treatment and control groups. However, evidence shows a 
trend in which the treatment group outperformed the control group slightly from pre- 
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test to post-test. It is possible that these results were due to some of the limitations 
of the study: in addition to facing participant attrition over the six-week period 
(the initial participant pool consisted of over 50 participants), the researchers also 
experienced inconvenient timing of the post- and delayed post-tests, as discussed 
in the previous section. Further research under more controllable conditions and a 
longer period of treatment is needed to determine how much the game can truly 
influence the development of oral fluency. 

Interviews with participants revealed that the treatment group’s improvement 
may be due to an increased motivation that results from game play, as observed 
in the literature (Wang, Khoo, Liu, & Divaharan, 2008). Oral production is a 
vital component of fluency development (Nation & Newton, 2008); however, 
students are less likely to participate orally due to high levels of anxiety and 
low levels of WTC (Gregersen & MacIntyre, 2014), reducing opportunities for 
relevant oral interactions (Horwitz et ah, 1986). Spaceteam ESL, on the other 
hand, requires a significant amount of oral production in a limited amount of time 
in order for teams to be successful. According to one student, his oral production 
was considerably higher during a 15-minute gaming session than in a three hour 
class: “more English in more small time... because in class I never speak because 
I don’t like [sic]”. Regarding anxiety and WTC, another participant reported 
that, while playing, he “didn’t pay attention about [his] nervosity in English”, 
which allowed him to focus on his speaking skills. Spaceteam ESL therefore 
creates a favourable environment for oral fluency development, one which will 
be investigated in further research. 

To summarize, Spaceteam ESL offers a combination of features to encourage 
fluency development, addressing the requirements for it to occur, as outlined by 
Nation and Newton (2008). The game also offers a fluency development activity 
that is pre-prepared and ready for use in the language classroom, requiring little 
preparation from the classroom teacher. Although results between the treatment 
and control groups were not significant, the data suggest that playing Spaceteam 
ESL as a warm-up activity has the potential to positively influence the development 
of oral fluency in L2 learners. 
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Feedback visualization in a grammar-based 
e-learning system for German: a preliminary 
user evaluation with the COMPASS system 

Karin Harbusch 1 and Annette Hausdorfer 2 


Abstract. COMPASS 3 is an e-leaming system that can visualize grammar errors 
during sentence production in Gennan as a first or second language. Via drag-and-drop 
dialogues, it allows users to freely select word forms from a lexicon and to combine 
them into phrases and sentences. The system’s core component is a natural-language 
generator that, for every new word the user wishes to attach to the current string (as an 
extension of this string or as a replacement of a substring), checks whether this tentative 
attachment is grammatically well-formed or not. On this basis, the system can compute 
and display online the grammatical structure of input strings in the form of syntactic 
trees, and identify and diagnose input errors. In the following, we focus on the crucial 
question of how to present the feedback to the learner. We propose tutored visualizations 
with animations of pedagogical agents. We briefly report the results of a preliminary user 
evaluation study in which the participants judged the well-formedness of prefabricated 
input sentences. The data, collected by means of eye-tracking and a questionnaire, show 
that L1 learners who are exercising an unfamiliar and error-prone grammatical structure, 
pay due attention to, and can profit from, this type of visualized error feedback. 

Keywords: ICALL, grammar teaching, natural-language generation, personalized 
feedback, evaluation. 


1. Introduction 


Automatically generating personalized, reliable and immediate learner feedback 
is an important prerequisite for effective learning in Intelligent Comp liter-Assisted 
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Language-Learning (ICALL). Molloy and Boud (2014) point out that “[feedback 
is a key process in learning, providing information on actual performance in 
relation to the goal of performance. [...] There is mounting survey data to 
suggest that students are dissatisfied with feedback” (pp. 413-414); see Narciss 
(2008) for a thorough overview of feedback strategies in language learning. In 
the area of German as a second language, studies by Diehl et al. (2000; native 
speakers of French at various high school levels) and Ballestracci (2005; native 
speakers of Italian at university level) underscore the importance of feedback 
tuned to the learner’s current performance level and his/her understanding of 
the explicitly presented grammar rules (see also Kartchava, 2012; van der Kleij, 
2013; Vamosfadrani & Ansari, 2011). 

In this paper, we focus on automatic feedback presentation in COMPASS, an 
e-learning system for German as a first and second language (described in several 
papers by Harbusch & Kempen, 2011; Harbusch, Hartel, & Cameran, 2013; 
Harbusch, Cameran, & Hartel, 2014). It confronts the learners only with errors 
they could have avoided, given their current proficiency level and their current 
understanding of the grammar rules. The relevant feedback calculated according 
to the learner’s proficiency level is provided by an animated tutor pointing out 
which problem COMPASS has identified and where it is located in the syntactic 
structure. In a user study we explore how the feedback visualization is perceived 
by test subjects. 

In Section 2, we argue for tutored visualizations with an animated pedagogical 
agent. Section 3 describes a preliminary user study with L1 learners as participants 
who judged the well-formedness of prefab input sentences that provided unfamiliar 
and error-prone grammatical structures. In the final Section 4, we draw some 
conclusions and address future work. 


2. Feedback in COMPASS 

In COMPASS, the user selects word forms from a lexicon and combines them 
into phrases and sentences via drag-and-drop dialogues. In response to each user 
action, the system displays the grammatical structure of the resulting word-form 
string in the form of a syntactic tree (see Figure 1). The system provides feedback 
on the (un)grammaticality of the string. In the example, both noun phrases are 
syntactically licensed as subject, although, ‘der Stein’ is semantically not an 
appropriate actor. However, none of the two can become the direct (cf. grammatical 
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function OA 4 =accusative object) or indirect object (cf. DA(=dative object) node) 
of the verb ‘sieht’ due to case mismatch. 

Figure 1. A snapshot of the COMPASS workspace illustrating a scenario where 
the learner has selected the verb form ‘sieht’ sees. Moreover (s)he has 
assembled and word ordered the two noun phrases ‘der Mann’ the man 
and ‘der Stein’ the stone. (N.B. linearization checking is activated 
by drawing nodes into the grey boxes around grammatical functions 
provided by each Kopf/head; outside the boxes only the hierarchical 
structure - relations between nodes - is validated) 



As mentioned by Harbusch et al. (2013), 

“the grammar formalism underlying COMPASS is Performance Grammar 
(Kempen & Harbusch, 2002), which uses separate rules for the hierarchical 
structure of a sentence and the linear order of its constituents. This split 
allows the student to divide a sentence construction exercise into relatively 
small parts. For instance, the learner can select a word, and inflect it as 
required by the intended grammatical function, without simultaneously 
considering the linear position of the constituent in the sentence under 
construction. At any time during this ‘scaffolded’ sentence construction 
process, the syntactic tree built so far remains visible on the screen, ready 
to be expanded or modified with additional words or phrases. Any sentence 
construction step can be undone and replaced online” (p. 105). 

Another advantage arises from the generation-based approach of COMPASS, 
where the learner and system assemble an unambiguous syntactic tree together. 
Compared to other systems that allow free sentence construction by the user but 

4. The annotations in trees resemble the ones in the TIGER corpus (Brants et al., 2004; e.g. KOUS=Unterordnende Konjunktion 
/subordinating conjunction). 
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rely on natural-language parsing, the feedback in a generation-based system is not 
hampered by ambiguous syntactic structures, meaning that feedback can be precise 
and exhaustive. However, as outlined in Section 1, it is desirable to highlight only 
those errors against rides the student is supposed to have mastered. COMPASS uses 
underspecification of grammar rules to accomplish this (cf. Harbusch et ah, 201 4; in 
the example in Figure 1, beginners might attach any of the two NPs as SB/OA/DA 
as case agreement is ‘overlooked’ by COMPASS on that proficiency level). 

The question we deal with in this paper concerns the format in which to present 
the feedback. Widely practiced in e-learning systems are animated tutors that 
interact with the user in a socially engaging manner (for a recent overview, see, e.g. 
Govindasamy, 2014). Adopting this format, we have chosen an owl - portrayed as 
intelligent and wise in Aesop’s fables - as a character capable to attract and motivate 
children as well as young adults. The user can select feedback at two levels of detail: 

(1) In verbose mode, if COMPASS spots an error, the owl shows up at the 
word or phrase the learner has just attached erroneously, and displays a 
box with information about the error type (see left panel in Figure 2 for an 
example of missing subject-verb agreement). 

(2) In concise mode, the owl has green eyes, sitting in a green box at the upper 
right corner as long as the user is building grammatically correct structures 
(right panel in Figure 2). In case of an error the color changes to red. 

The user can switch off feedback if desired. 

Figure 2. Syntactic structures with feedback. Left image: verbose feedback 
presented after a subject-verb agreement error. Right image: concise 
feedback after a correct attachment 
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3. A preliminary system evaluation using eye-tracking 

In order to find out whether the feedback was sufficiently salient and informative 
to attract the attention of the users, we performed an eye-tracking experiment with 
20 adult native speakers of German (university students) who were instructed 
to judge the grammatical correctness of displayed sentences. We also asked 
the participants to express in a questionnaire their subjective impression of the 
usefulness of the feedback. 

The experiment comprised two phases. In Phase I, the participants familiarized 
themselves with COMPASS by freely composing syntactic trees in drag-and-drop 
dialogues with the system. Then, in Phase II, they were presented with prefabricated 
sentences featuring correct or incorrect subject-verb agreement (adapted from an 
experiment by Bock & Miller, 1991), allowing them to exercise relatively rare 
and error-prone agreement cases. In addition to these experimental sentences, 
there were filler sentences that were either grammatically correct or contained 
other types of errors. In one experimental condition, the participant delivered his/ 
her grammaticality judgment, and the owl indicated the (un)grammaticality of 
the input sentence in the manner illustrated in Figure 2. All sessions were video- 
recorded and transcribed. 

Figure 3. ‘Heat maps’ representing fixation durations for the images in Figure 2. 

Green spots: short fixations; fixation durations increase via yellow to 
red. Left image: fixation pattern in case of a subject-verb agreement 
error; right image: fixations in case of positive feedback 



As indicated by the ‘hot spots’ in the heat maps (Figure 3), the participants did pay 
attention to the feedback agent. The percentage of correct answers increases from 
52% in the control condition (no tree, no feedback) to 67% in the experimental 
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condition with syntactic trees (more precisely, in the experimental subcondition 
without feedback where the owl did not give away the correct answer). This 
suggests the feedback was not only perceived but also yielded a learning effect. 
The questionnaire data showed that several participants (5 out of 20) found the 
trees baroque and confusing rather than helpful. These participants did not profit 
from the feedback. 


4. Conclusions 

The results of our preliminary user evaluation experiment suggest that our way of 
presenting feedback via an animated pedagogical agent is promising. However, the 
questionnaire revealed considerable dissatisfaction with the level of detail of the 
linguistic information provided by COMPASS. The participants’ complaints ranged 
from too many colors to too much linguistic sophistication. We take these results as 
recommendations to continue with feedback presentation in the form of animated 
tutors and with syntactic trees, but also to simplify the tree format considerably. 
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during videoconferenced pedagogical interaction 
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Abstract. This study aims to identify and analyze the ways in which semiotic 
resources are orchestrated by teacher-trainees during videoconferenced French 
foreign language teaching. Our corpus is made up of six weeks of interaction 
between seven teacher trainees enrolled in a master’s program at Universite Lumiere 
Lyon 2 in France and 12 undergraduate business students at Dublin City University 
in Ireland. 15.5 hours of video data were transcribed using ELAN, and 195 lexical 
explanation sequences were identified. These sequences were categorized according 
to whether the lexical problem came from an inability to understand or an inability 
to speak, and were then split into phases according to a three-step canonical model 
(Lauzon, 2008). During each phase we look at which semiotic resources were used, 
combined and co-contextualized by the teacher trainees. Our methodology, which 
will be used to complete our PhD project, is outlined here as well as preliminary 
results. 

Keywords: videoconferencing, lexical explanation, multimodality. 


1. Introduction 

It has been shown that during native-non-native and non-native-non-native 
interaction, negotiation sequences are most commonly initiated by lexical triggers 
(Nicolaev, 2010; Smith, 2003). Various models for negotiation sequences have 
been proposed (Smith, 2003; Varonis & Gass, 1985) to describe how a negotiation 
sequence unfolds in time. Lauzon (2008), for example, presents a three-step 
canonical model specifically for lexical explanation sequences during teacher- 
student interactions. A lexical explanation sequence occurs when the normal 
progression of a conversation or activity comes to a halt and participants orient 
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their focus towards a lexical item that a learner fails to understand or fails to 
produce. In the first case, the non-understood lexical item comes from the teacher’s 
discourse or from a pedagogical support such as a video, audio track, text or image. 
In the second case, failure to produce a lexical item hinders the learner’s foreign 
language output. The teacher must intervene to explain the non-understood lexical 
item or provide a sufficient one in order for communication to resume. In Lauzon’s 
(2008) three-phase canonical model, there is an opening, a nucleus, and a closing. 
During the opening phase, the lexical item that is either misunderstood or searched 
for by the learner is recognized by the participants and problematized. During 
the nucleus, the teacher attempts to explain the non-understood word or provide 
the correct word that is being searched for by orchestrating various linguistic and 
multimodal resources. During the closing phase, the learner’s comprehension or 
ability to properly use the just-provided word is evaluated or ratified by the teacher. 

Of interest to us are the ways in which the different phases are multimodally 
orchestrated by the participants. A multimodal phase (Baldry & Thibault, 2006) 
is defined by semiotic coherence. During each phase, different modes (voice, eye 
contact, posture, proxemics, head movements, facial expressions, gestures, written 
text, etc.) work together in synergy to make meaning, with the hierarchy of modes 
constantly being rearranged and renegotiated by the participants (Norris, 2004). 
According to Norris (2004), a mode has high modal density if it carries most of 
the meaning at a given time or if communication would come to a halt if it were 
removed. In a videoconferencing environment such as Vi.su (Guichon, Betrancourt, 
& Prie, 2012), these modes are channeled through the affordances of the platform. 
In our case, Visu offers a video channel, an audio channel, a text chat channel, 
and the ability to send prefabricated instructions and multimedia documents 
such as images and links to external websites. The aim of this study is to identify 
what modes are used for what purposes during each phase of lexical explanation 
sequences and to explore the ways in which the modes interact with each other. 


2. Method 

2.1. Corpus 

Our corpus, which is part of the ISMAEL project (Guichon, Blin, Wigham, & 
Thouesny, 2014), consists of six weeks of videoconferenced interactions mediated 
by Visit during the fall semester of 2013 between seven future teachers of French 
enrolled in a master’s program for teaching French as a foreign language at 


186 




The multimodality of lexical explanation sequences... 


Universite Lumiere Lyon 2 in Lyon, France, and 12 undergraduate learners of 
French at Dublin City University in Dublin, Ireland. These undergraduate business 
students had a level B1-B2 in French and were preparing to complete an internship 
the following year in Reims, France. The 40-minute interactions were specifically 
engineered for business purposes and were centered around themes such as paid 
vacation, strikes, coffee breaks, professional experience, project management, job 
interviews, etc. The 28 interactions that were collected have a total time of 15.5 
hours and were transcribed using ELAN (Wittenburg et ah, 2006). 

The verbal and text chat channels were transcribed for all participants for the entire 
corpus. Next, we identified 195 lexical explanation sequences and split each one 
into phases using the model mentioned above. The lexical explanation sequences 
were then divided almost evenly into two main categories: sequences resulting 
from a comprehension problem and those resulting from a production problem. 


3. Preliminary results and discussion 

Each multimodal enviromnent has a unique palette of semiotic resources, which 
makes direct comparisons difficult. For this particular multimodal environment, our 
phase-by-phase preliminary analysis shows that a diverse range of semiotic resources 
was used during the opening, nucleus and closing phases for different purposes. 

Gestures, which play a critical role during classroom foreign language teaching 
(Tellier, 2008), were put to use during some lexical explanation sequences. In 
particular, during word searches, teachers sometimes used gesture to verify their 
own comprehension of the word being searched before providing it. For example, 
when asked by a learner how to say ‘yawning’ in French, one teacher trainee, 
unsure of her own comprehension of the English word, used a gesture to verify it 
before providing the French translation (see Figure 1 , left). For sequences triggered 
by incomprehension, gestures were used to describe actions, concepts, concrete 
objects, and even explanation strategies. For example, when explaining the verb 
‘to strike’, one teacher-trainee illustrated the act of chanting slogans by moving his 
arm up and down in front of the webcam (see Figure 1, center). On many occasions, 
gestures carried high modal density because they were produced in the absence of 
speech (such as in the ‘yawning’ example) and/or deliberately placed directly in 
front of the webcam. The third teacher-trainee pictured below (see Figure 1, right) 
rarely made gestures visible to the webcam, but in this case made an effort to make 
her emblematic gesture visible when illustrating the concept of adding a zero to a 
monthly paycheck. 
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Figure 1. Gestures produced by teacher-trainees during lexical explanation 
sequences 





Earn a little extra 


"It's when people stop working and they go out 
in the [street to chant slogans] and want better 
working conditions." 


how it is 

in Ireland but in France you receive your salary and 
I your paycheck at the end of the month, so when you 
| "round the end of the month” you're supposed to 
1 [add a zerol okay so you have a bigger paycheck." 


The text chat was used during all three phases. Before incomprehension was 
manifested, teacher-trainees often anticipated the difficulty of a word by typing 
it in the text chat window. During the nuclei and closing phases, teacher-trainees 
used the text chat to type the word that was either just explained or provided in 
order to offer a visual representation and reinforce memorization. Text messages 
were not always redundant, often obtaining high modal density when produced 
in the absence of oral speech. Multimedia documents were also sent during all 
three phases of lexical explanation sequences having to do with incomprehension, 
either to present learners with a visual representation before, during or after the 
explanation. 

Finally, we have found synchronization and co-contextualization of resources. The 
text chat was often co-contextualized by other resources: teacher-trainees regularly 
said, “I’m putting it in the chat window” or made gestures pointing to the chat 
window. The sending of documents was similarly co-contextualized by the verbal 
channel. Teacher-trainees tended not to make hand gestures and send written 
messages simultaneously due to the difficulty of typing and making gestures at the 
same time. 


4. Conclusions 

More data must be analyzed in order to proceed to any sort of statistical analysis. 
Furthermore, facial expressions, eye movements, eyebrow movements and posture, 
which are important meaning-making resources in face-to-face interaction, still 
need to be analyzed. For our PhD project, by using the methodology outlined 
above, we will analyze the entirety of our 195-sequence corpus in order to spot 
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patterns, explore variation between the participants, and eventually propose a 
structural model for videoconferenced lexical explanation sequences similar to the 
one proposed by Smith (2003) for synchronous text-based negotiation sequences. 
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Abstract. This paper presents an automatic dialogue scoring approach for a 
Dialogue-Based Computer-Assisted Language Learning (DB-CALL) system, 
which helps users learn language via interactive conversations. The system produces 
overall feedback according to dialogue scoring to help the learner know which 
parts should be more focused on. The scoring measures are presented, including 
task proficiency, grammar accuracy, vocabulary knowledge, and syntactic ability, 
to assess the user performance during the dialogue. A user evaluation is performed 
on the automatic dialogue scoring results and the generated feedback to collect the 
feedback from real learners, and to see if the measures are helpful and proper. A 
discussion is also held about the difference between the automatic dialogues scoring 
from essay scoring based on the user evaluation. 

Keywords: computer-assisted second-language learning system, dialog-based 
CALL, automatic dialogue scoring, feedback for L2, automatic essay scoring. 


1. introduction 


A DB-CALL system usually provides grammar correction feedback with a 
grammar checker, and discourse feedback via a semantic checker. We have 
developed GenieTutor (Kwon, Lee, Kim, & Lee, 2015a; Kwon et al., 2015b), 
which is a DB-CALL system for English learners in Korea. GenieTutor leads 
dialogues by asking questions on different topics according to given scenarios, 
language learners answer questions orally, and the system recognises the speech. 
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evaluates if the answers are semantically proper for given questions, and checks 
grammatical errors and provides feedback (Lee, Kwon, Kim, & Lee, 2015). The 
dialogues normally consist of two to four turns, and the system provides semantic 
and grammar error feedback in each user utterance, deciding if the dialogue can 
move to the next turn. During the development and user tests, we noticed that 
users would like to know their overall scoring and level after finishing a whole 
dialogue. 

In this paper, we investigate the dialogue scoring measures for the GenieTutor 
system. The measures include task proficiency, grammar accuracy, utterance length 
and complexity, vocabidary level and diversity. Synonyms are also provided as 
suggestions to improve user vocabulary. 


2. Measures for automatic dialogue scoring 

Speech scoring has focused on restricted and highly predictable speech, mainly 
evaluating aspects of speaking related features, including pronunciation, intonation, 
rhythm, and fluency, such as speaking rate or length and distribution of pauses. 
For automated scoring of unrestricted spontaneous speech, more speaking content 
related features are adopted, including grammatical accuracy, syntactic complexity, 
vocabulary diversity, and spoken discourse structure (Chen & Zechner, 2011; Xie, 
Evanini, & Zechner, 2012). These speaking content related measures are similar to 
the essay scoring, because they both intend to assess communicative competence 
(Attali & Burstein, 2004). 

Our DB-CALL system has expected user answers for each system utterance, similar 
with the restricted speech scoring. However, considering it is a dialogue system, some 
factors of unrestricted spontaneous speech should also be considered in the scoring. 

The first measure investigated for dialogue scoring is dialogue proficiency, 
indicating how fluently the conversation has been maintained, it consists of task 
turn pass ratio and user utterance pass ratio, where task turn pass ratio is the ratio 
of the passed turns out of all task turns. For example, there are 3 turns predefined 
for the scenario, if the learner passes two turns and gives up in the final turn, than 
the task turn pass ratio is 66.7%. 

User utterance pass ratio is the ratio of the passed user utterances out of all user 
utterances. For example, for a dialogue with two task turns, the learner finished it 
with five utterances. Then, there are two task turns, two passed user utterances out 
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of all five user utterances, then the user utterance pass ratio is 40% while the task 
turn pass ratio is 100%. If a user utterance passes, the task turn is performed by the 
semantic correctness module (Kwon et al., 2015a). 

The second measure is grammar accuracy. Grammar checks have been performed 
by grammatical error correction modules in each turn (Lee et al.. 2015). What 
dialogue scoring needs to do is compute the accuracy according to the weighted 
number of grammar errors, dividing this by the total number of words in all user 
utterances. This measure is the same with essay scoring (Attali & Burstein, 2004). 

The third measure is vocabulary, including vocabulary level and diversity. Vocabulary 
level has five categories, from primary school level to university level. Vocabulary 
level estimates the user word level according to the word distributions by dividing 
the number of user words in zth category (/uiw.i) to the number of user words (/raw), 
and compares it with the vocabulary level of the scenario - a scenario which provides 
correct references from native speakers. Each category has different a weight vvi. The 
vocabulary level would be set to one if the dividing result is higher than one. 

Vocabulary diversity is the ratio of number of word types to tokens in the user 
utterances (Attali & Burstein, 2004). However, different from essay scoring, 
the ratio should be a relative one compared with the vocabulary diversity of the 
scenario. For example, in user utterances “Movies interest me a lot”, “I’m interest 
in Action Movies a lot”, there are nine word types, “movies, interest, me, a, lot, 
I, am, in, action” and 13 tokens, so the diversity is 0.69 (9/13). Again, it is also 
divided into the vocabulary diversity of the scenario, which would be set to one if 
the dividing result is higher than one. 

The system provides synonyms and similar expressions to improve user vocabulary 
if the same word is adopted several times in the user utterances. For above cases, 
GenieTutor will suggest ‘See also these similar expressions: interest > fascinate, 
attract, entertain’. 

Syntactic ability includes utterance length and syntactic complexity, the former relates 
with the utterance lengths, while the complexity considers the syntactic structure of 
the utterances. Utterance length compares the lengths of user sentences to the length 
of references in the scenario, and syntactic complexity gives relative complexity 
scores by considering the length of the utterances and the number of conjunctions. 

Dialogue score is the weighted average of all above measures. The system provides 
overall feedback according to the dialogue score (Figure 1). 
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3. Survey and discussion 

A survey on the GenieTutor overall feedback are performed involving 30 human 
evaluators, 14 of them elementary English learners, and 16 intermediate learners. 
They are asked five questions, from range one to five, from ‘Strongly disagree’ to 
‘Strongly agree’, respectively. The evaluators needed to pick at least one item for 
the final question. 


Table 1. User evaluation on the overall feedback generated from dialogue scoring 


Idx 

Questions 

Score 

1 

Do you think overall feedback would be helpful 
to improve your conversation level? 

3.53 

2 

Do you think overall feedback would be helpful to motivate your learning? 

3.67 

3 

Do you think the evaluation items of the overall feedback are proper? 

3.97 

4 

Do you think the overall score and the final feedback are proper? 

3.50 

5 

Which evaluation item(s) do you 
think unnecessary among the 
overall feedback? You can pick one 
or more from following items : 

A. Overall score 

4 

B. Task proficiency 

8 

C. Grammar 

1 

D. Vocabulary 

1 

E. Syntactic 

17 


From Table 1, we can see that the human evaluators considered the overall 
feedback tend to be helpful to their English learning (average scores=3.53/3.67 
for the first and second questions). About the evaluation items of the overall 
feedback, the users think measuring items are proper (average score=3.97 for 
the 3rd question). However, the scoring of the items are considered as just tend 
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to be proper (average score=3.50 for the 4th question), implying that the scoring 
approach still needs to be fine-tuned to reflect the learner’s performance more 
accurately. 

Interestingly enough, more than half of the evaluators think the measure Syntactic 
is less necessary (17 votes out of 30 evaluators), while Vocabulary and Grammar 
measures get only one vote, respectively. It indicates dialogue scoring should 
be different from essay scoring considering that the Syntactic measure is one 
of the most important measures in essay scoring. The dialogue in GenieTutor is 
restricted and predictable, which is very different from the essay. For example, 
the learner already learns the dialogue “what kind of movies do you like? —> I 
like Action Movies” from the given class (scenario). Flowever when the learner 
utters the same sentences in the practice, the syntactic complexity measure 
would give a lower score to the user utterance, and suggest try to practice longer 
expressions: I’m interested in Action Movies a lot. The task proficiency gets eight 
votes mostly from the speech recognition problem - the learner complains that, 
when the speech is not recognised correctly, the user utterance would get failure 
in semantic check, it reduces turn pass ratio and reflects the accuracy of task 
proficiency. It means the performance of the speech recognition could impede 
the participants’ views. 


4. Conclusion 

This paper investigated the measures for automatic dialogue scoring and 
performed user evaluation on the overall feedback. The result showed that the 
overall feedback after a dialogue tended to be helpful to the language learner, even 
if there were already turn-by-turn feedback provided for semantic and grammar 
error correction. The user evaluation result also showed that the dialogue scoring 
for a DB-CALL system should be different from automatic essay scoring in some 
measures - in our case, the syntactic ability measure was considered less helpful 
than others, while grammar and vocabulary measures were considered necessary 
with the overall score. 
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Abstract. The purpose of this study is to find the effects of using Videoconferencing 
(VC) as a tool for foreign language instructions in a semester long research study. 
The research questions focus on the effects of VC (1) on speaking skills, and (2) 
on general proficiency scores. English as a Foreign Language (EFL) learners in a 
university in Japan were divided into an Experimental Group (EG) with weekly 
VC outside the classroom, and a Control Group (CG) provided with ‘shadowing 
practice’ and written assignments instead of VC. Both groups spent eight weeks 
under the treatments with pre and post measurements. The results showed 
improvement in holistic ratings and temporal measurement in transcribed speech 
data, but not statistically significant in interaction between time and treatments. 
Speaking performance of the EG showed statistically more significant progress in 
fluency and lexical variation, and in general proficiency. The results suggest that 
using VC with tasks in a blended manner with classroom instruction develops 
balanced L2 competence and performance. 

Keywords: videoconferencing, task-based language learning, speaking, proficiency. 


1. introduction 

It is not easy to find regular opportunities for interaction in English with fluent 
English speakers in an EFL context such as Japan. Even some learners who attend 
conversation classes in universities cannot be given sufficient time to talk in English 
with English speaking instructors due to large class sizes. This situation leads to 
the fact that many learners in Japan cannot communicate sufficiently in English, 
particularly in speaking (MEXT, 2016). This fact also leads to an increasing number 
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of people counting on English language programs through VC (Yano Economic 
Research Institute, 2015). 

However, one problem with commercial programs using VC for language 
learning is that the content dealt with in sessions seems not to expand learners’ L2 
competence but just to the extent that the learners manage to develop fluency in 
daily conversation. Therefore it appears necessary to introduce frameworks from 
Second-Language Acquisition (SLA) such as task-based language learning, which 
facilitates L2 development (Gonzalez-Lloret & Ortega, 2014). 

As a solution to such issues, we have implemented interaction-based instruction with 
the goal of role-play tasks through VC with English speakers. Hence, the purpose of 
the study is to find the effects of using VC as a tool of foreign language instructions 
in a semester long research project. The aim of this study is to investigate the effects 
of the instruction that includes VC as its communicative goal (1) on speaking skills, 
and (2) on general proficiency consisting of vocabulary, reading and listening. 


2. Method 

2.1. Participants and instructional conditions 

The EG, consisting of 22 university level learners of English in Japan experienced 
eight role-play task sessions through VC over the course of one semester. The 
weekly VC sessions were held with English teachers living in the Philippines. The 
teachers had experience in teaching English in a language school in the Philippines, 
so they were familiar with how to handle a discussion class with two learners. Each 
session was 45 minutes long. We gave the teachers a brief scheme for the 45 minute 
sessions: ten min. for warm-up, 25 min. for a role-play task and ten min. for cross- 
cultural questions which the learners prepared in order to learn about the situation 
in the Philippines in accordance with the topic they discussed in the role-play task. 

The issues for VC sessions were from a listening course book with which 
the learners do listening comprehension and dictation on their own before a 
preparatory class, a 90 minute regular class. In the class, being conducted by 
a Japanese teacher of English, the following five steps were taken: (1) free 
discussion between the learners on the issue; (2) sharing of words and expressions 
as ‘gaps’ they noticed - the teacher provided L2 expressions equivalent to LI 
based on the notes of ‘what they wanted to say but could not’; (3) presentation 
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by an assigned group of learners on the issue in order to stretch their content 
knowledge; (4) re-discussion on the same issue to incorporate their learning in 
Step 2 and 3 with different learners; and (5) role-play practice in triads among the 
learners, in which they could switch roles in order to prepare for any role in the 
task. After the preparatory class, paired learners experienced the same role-play 
task through VC with the teachers in the Philippines. As a post task, the learners 
were given a writing assignment. 

The CG, consisting of 27 learners in the same university, were provided with the 
same listening pre-task as EG before their weekly 90 minute classes. They used the 
same materials, and experienced the same steps in the classroom up to the part of 
a role-play among the learners. Instead of VC, however, they were assigned to do 
‘shadowing practice’, i.e. repeating or reproducing aloud the sound of the listening 
material for ten minutes daily and to keep a record of it. They were assigned to 
write a short essay on the same topic as well. 

2.2. Data collection tools and procedures 

The test followed the style of the TOEFL Speaking Section Part 1. Learners 
were asked, for example, ‘Some students prefer to work on class assignments by 
themselves. Others believe it is better to work in a group. Which do you prefer? 
Explain why’. The teacher read aloud the question and provided 15 seconds for 
planning, then had the learners talk in the microphone in a computer-assisted 
language learning system for 45 seconds. The learners’ oral production was 
recorded and rated up to four points by three raters, including the authors using the 
TOEFL Independent Speaking Rubric (a=. 94). The spoken language was manually 
transcribed and analyzed quantitatively. 

The Eiken 1BA is a multiple choice question style standardized proficiency test 
consisting of listening and reading parts. Each part consisted of 50 questions; 
the reading part included 15 vocabulary featured questions. We used the score 
percentage in each section to compare the progress of the CG and EG. 


3. Results and discussion 

In order to make the two groups homogenous in the initial evaluation score in the 
TOEFL style test, the number of the participants became 30, that is 15 in each 
group by cutting the top learners in the EG and the bottom layer of the CG. 
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For the TOEFL style speaking test, the result of two-way ANOVA repeated 
measurements showed no significant interaction (7 7 (1,28)=2.66, /?=.114, t/ 2=.02,) 
but a significant difference between pre- and post-tests (Time : 7 7 (1,28)=28.78, 
p<. 001, t/ 2=.24,). Regarding the quantitative analysis of temporary measurement 
based on the transcribed data, significant interactions indicating EG>CG 
were observed in two variables: fluency by word per minute (7 7 (1,28)=9.49, 
p=. 004, 7/2=.05), and lexical variation by type-token ratio in the Giraud Index 
(F’(l,28)=8.99, j p=.006,7/2=04). 

For the results of the Eiken 1BA proficiency test, the EG outperformed the CG 
with a significant interaction (7 7 (1,28)=6.11, p=.0\9, 7/2=.04). Hence it can be said 
that VC brought about more L2 development in overall proficiency. These positive 
results for VC are in accordance with effects of interaction in SLA. 


4. Conclusions 

In this research, we found that providing task-based interaction using VC to EFL 
learners improved their speaking ability in fluency and lexical variation. The 
instruction also improved listening and reading proficiency. These findings add 
more evidence of positive effects of using VC in a sequence of L2 instruction. 

In conclusion, since the CG also showed improvement in speaking, creating 
opportunities for L2 interaction with role-play tasks particular in EFL contexts 
can be a necessary condition, and VC session as a goal of interaction can be 
regarded as a satisfactory condition to enhance further L2 development in fluency 
and complexity. 
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Abstract. The present paper describes a case study on the effects of telecollaborative 
games on learners’ motivation. 12 learners from a Dutch and a British secondary 
school participated in the study. Different games, which included gamification 
elements, were developed on OpenSim. The overall educational goals of the games 
were to enhance cultural awareness and intercultural communication of German as a 
foreign language. Three different cross-cultural groups played the telecollaborative 
games in two different sessions. Data from pre- and post-surveys were gathered for 
measuring the impact of telecollaborative games on learners’ motivation. At the end 
of the game sessions, focus group discussions were organised for evaluating the 
experience. The results indicate that telecollaborative games have a positive impact 
on learners’ motivation. 

Keywords: virtual worlds, gamification, telecollaboration, motivation, youngsters. 


1. Introduction 

Video games and virtual worlds are viewed as relevant educational tools not just for 
their potential for entertainment, but also for promoting learning (Prensky, 2007). 
This is mostly due to game techniques that seem to promote user engagement 
and motivation. These techniques are increasingly being employed in so-called 
serious games: games whose main purpose is to educate while entertaining their 
users. Recently, a growing awareness of the learning potential of games and 
virtual worlds has been observed in the computer-assisted language learning field 
(Cornillie, Thome, & Desmet, 2012; Jauregi et al., 2011; Panichi & Deutschmann, 
2012; Reinders, 2012; Sykes & Reinhardt, 2012). This paper presents the results of 
a case study on the effects of telecollaborative games on learners’ motivation, who 
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are learning German as a foreign language in secondary schools. Different cultural 
games were developed on OpenSim which included several gamification elements. 
In order to achieve game goals pupils were required to collaborate with peers. They 
all used German as a lingua franca. The games were played cross-culturally in a 
virtual international setting. Our approach to the analysis of motivation is based on 
the self-determination theory framework (Ryan & Deci, 2000). 


2. Method 

The main research question we address in the present case study is: How do cultural 
games played cross-culturally in OpenSim influence learners’ motivation? 

2.1. Subjects 

12 learners from a Dutch and a British 2 secondary school participated in the study: 
ten boys and two girls. They were between 14 and 15 years old. Three cross- 
cultural teams with two Dutch and two British pupils each were created to play 
the games. The pupils learned German as a foreign language at their school. Their 
proficiency level ranged between A1 and A2. The experience was carried out 
within the framework of the European T1LA project 3 . 

2.2. Games 

Two series of games 4 were developed in the T1LA grid of OpenSim, an open source 
3D virtual environment, where users represented as avatars can communicate using 
textual chat or voice, move around, interact with objects and engage in action. The 
games had a German cultural focus. All quizzes, hints and explanations were in 
German. The gamification elements included both time and point counts. 

Each game cycle had five different spaces with a different game in each space. In 
the first room (see Figure 1), each team member received hints (example of hints: It 
is a German city. Carnaval is celebrated here. It is in the west) when sitting down 
around a table. Together the pupils had to be able to create the password that when 
being written in the chat box would open the door to the next game space. 


2. Secondary schools: The Ashcombe School, Dorking, United Kingdom. Pleincollege Nuenen, Nuenen, The Netherlands. 

3. Telecollaboration for Intercultural Language Acquisition: www.tilaproject.eu 

4. The games were developed by the collaborating teachers at both schools: Helen Meyer and Bart Pardoel. Nick Zwart 
developed the games in OpenSim. 


202 





Telecollaborative games for youngsters: impact on motivation 


Figure 1. First room in the cultural German game 



Figure 2. Pupils playing the game on the German cultural quizzes 



In the second room the hints appeared in the walls when standing on specific yellow 
plates (examples First day of the week... The opposite of west... The opposite of 
north... No right hand...). The team members had to discover a five-letter word 
(example: the name of a German river). In the third game room the group split up 
into two dyads. The two dyads had to cooperate to build a bridge with the blocks 
floating on the water and be able to cross the water to continue with the last games. 
The builders had to communicate purposefully with the other dyad, as these were 
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the ones who could move the blocks by following the directions provided by the 
builders and the other way round. In the fourth game room there were four quiz 
chairs. When sitting on the chair the pupils got the quiz in the form of multiple 
choice questions (example of questions: In which country is German notan official 
language? In which city was the wall? How many inhabitants has Germany?). If 
they knew the right answer they got a point and the chair raised automatically (see 
Figure 2). All team members had the same quiz questions and were expected to 
discuss and share the answers in order to be able to get the highest amount of points 
with the whole team. 

In the final game room, the pupils had to find the right ingredients for two different 
German recipes displayed on the walls. If they clicked on the wrong ingredient 
they got a point deducted. When clicking on the right ingredient they received a 
point. The winner was the team with the most points in the shortest period of time. 

2.3. Motivation surveys 

Several surveys were developed: 

• A background survey, that included biographic information and language 
learning experience. It was filled by all participants before playing the 
games. 

• The user experience survey gathered information about the game and was 
filled in after each game session. 

• A post-survey on the general experience was filled in after the second 
game session. 

In this short paper we will be presenting the results of the user experience survey 
and will compare the results per game and pupil cluster. For the closed items a 
five-point Likert scale was used with low values indicating non agreement and high 
values total agreement. 


3. Results 

Mean and Standard Deviation (SDev) values were calculated for the different 
items. The pupils enjoyed the German cultural game being played cross-culturally 
among Dutch and British pupils. Technically, they found it easy to play the game 
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and the sound and video quality were very good, particularly in the second game 
session (see Table 1). 


Table 1. SDev values on technical issues for the British and Dutch pupils playing 
Games 


Item 

British | Dutch 

Game 1 

Game 2 Game 1 

Game 2 

Technology 

Mean 

SDev 

Mean 

SDev 

Mean 

SDev 

Mean 

SDev 

It was easy to USE the game 

3.6 

0.5 

4.2 

0.8 

4.2 

0.4 

4.5 

0.5 

SOUND was good 

3.8 

0.4 

3.8 

0.8 

3.6 

0.9 

4.5 

0.5 

VIDEO was good 

3.5 

0.6 

4.3 

0.5 

4.4 

0.5 

4.7 

0.5 


Pupils liked very much to communicate and interact in the game environment with 
pupils from other countries (see Table 2). They liked the game environment and 
being an avatar. Interestingly, the scores of the British pupils in the second game 
are much higher than in the first game session, while for the Dutch ones the scores 
on the second game were a little bit lower than in the first game, but still very high 
(mean values above 4.0). 


Table 2. Values for pupils’ preferences and likes 


Item 

British | Dutch 

Game 1 

Game 2 Game 1 

Game 2 

Preferences & Likes 

Mean 

SDev 

Mean 

SDev 

Mean 

SDev 

Mean 

SDev 

1 like to communicate and interact in this game environment 

3.8 

0.4 

4.5 

0.5 

4.6 

0.5 

4.2 

0.8 

1 like to meet students from other countries in this game environment 

4.2 

0.8 

4.7 

0.5 

4.6 

0.5 

4.2 

0.8 

1 like to learn in this game environment 

4.0 

0.0 

4.5 

0.8 

4.4 

0.5 

4.0 

0.9 

1 like to be an avatar 

4.6 

0.5 

4.5 

0.5 

4.4 

0.5 

4.3 

0.8 


As to satisfaction and ease factors, British pupils seem to have felt more comfortable 
and co-present in the second game than in the first one, scores reaching very high 
values. The Dutch pupils felt very positive about the games but the scores in the 
second were slightly lower (see Table 3). 


Table 3. Values for pupils’ satisfaction and ease issues 


Item 

British 1 Dutch 

Game 1 

Game 2 Game 1 

Game 2 

Feel 

Mean 

SDev 

Mean 

SDev 

Mean 

SDev 

Mean 

SDev 

1 felt comfortable during the game 

3.8 

0.4 

4.7 

0.8 

4.2 

0.4 

4.2 

0.8 

1 felt 1 was in the same place with the others 

3.8 

0.4 

4.2 

1.3 

4.2 

0.4 

3.7 

1.0 

1 felt satisfied with the way 1 communicated 

3.8 

0.4 

4.0 

0.9 

4.0 

0.0 

3.8 

1.0 

1 felt the game environment affected in my communication positively 

4.0 

0.0 

4.5 

0.8 

4.2 

0.4 

4.0 

1.1 

1 felt part of a group 

4.0 

0.0 

4.2 

1.3 

4.0 

0.7 

4.3 

0.5 


Finally, pupils were very enthusiastic about the game and the possibility to play it 
with pupils from another country. They would recommend to other pupils to play 
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these games and they would themselves like to engage in these kinds of games 
more frequently (see Table 4). All values were very positive. Yet it was remarkable 
that the scores of British pupils were considerably higher in the second game than 
in the first one. 


Table 4. Overall game experience 


Item 

British | Dutch 

Game 1 

Game 2 Game 1 

Game 2 

Game 

Mean 

SDev 

Mean 

SDev 

Mean 

SDev 

Mean 

SDev 

1 enjoyed communicating with students from another country 

4.2 

0.4 

4.7 

0.5 

4.2 

0.4 

4.0 

1.1 

1 enjoyed the game 

4.0 

0.0 

4.4 

0.9 

4.6 

0.5 

4.7 

0.5 

Because there was interaction with pupils from other countries... 

4.0 

0.0 

4.6 

0.5 

4.6 

0.5 

4.7 

0.5 

1 found the game useful for my language learning 

4.0 

0.0 

4.6 

0.5 

4.4 

0.5 

4.2 

0.8 

1 would suggest to a friend to take part in this kind of international games 

4.0 

0.0 

4.6 

0.5 

4.6 

0.5 

4.2 

0.8 

1 would like to use games with pupils from other countries more often 

4.0 

0.0 

4.6 

0.5 

4.6 

0.5 

4.3 

0.5 


4. Conclusions 

Pupils greatly enjoyed playing the cultural games with peers from another country. 
Interestingly, Dutch pupils were very positive about the telecollaborative game 
experience from the very beginning, while the British pupils started quite cautiously 
in the first game but grew considerably in self-confidence and satisfaction in 
the second game. This case study seems to indicate that serious games played 
telecollaboratively can contribute to boost the learners’ motivation to learn foreign 
languages meaningfully and playfully. Additional research is needed to confirm 
these initial findings. 
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Abstract. The Exercise, an Exercise generator in the SOURCe project, is a tool 
that complements the properties and functionalities of the SOURCe project, which 
includes the search engine for the Searchable Online French-Greek parallel corpus 
for the UniveRsity of Cyprus (SOURCe) (Kakoyianni-Doa & Tziafa, 2013), the 
PENCIL (an alignment tool) (Kakoyianni-Doa, Antaris, & Tziafa, 2013), and the 
Synonyms and the Library tools. These are designed as freely available resources for 
language processing, easy to use by teachers and learners. The Exercise tool enables 
teachers to create either online activities or print out paper-based worksheets, 
including a variety of texts and activities on topics, in a variety of exercise types 
(e.g. multiple choice, word, phrase or sentence matching, filling the gaps with 
missing words/phrases, text reconstruction, listening, etc.). 

Keywords: exercise generator, computer-based language testing, teachers’ tool, 
language acquisition. 


1. Introduction 

The SOURCe project aims at providing a whole platform of tools to assist the 
French language teachers in the classroom. In this paper we present the latest tool 
called Exercise, an Exercise generator in the SOURCe project. This is the fifth tool 
of the SOURCe project, which consists of: 

• The Source 4 Corpus tool, which is a search engine for the searchable online 
French-Greek parallel corpus for the university of Cyprus (Kakoyianni- 
Doa & Tziafa, 2013). 
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• The PENCIL tool, an alignment tool for translators, teachers and learners, 
which enables the creation and customisation of web-based corpora, by 
uploading and aligning French and Greek texts (Kakoyianni-Doa et al., 
2013). 

• The Synonyms tool, which provides a search engine for synonyms, based 
on machine translation or dictionary searches. 

• The Library tool, which showcases a part of the SOURCe project corpus. 

• The Exercise tool (presented in the following sections), which enables 
teachers to create online activities and/or print out paper-based worksheets. 

Following Kakoyianni-Doa and Tziafa’s (2013) methodology, “all these tools 
and functionalities are designed as freely available resources for language 
processing, along with the data to be processed, in usable formats for both 
teachers and learners” (p. 2) (Figure 1). As regards the parallel corpora, “the 
translations included are based on human understanding of textual relations, 
which is not the case for machine translation (yet), despite the fact that students 
tend to rely more and more on it” (Kakoyianni-Doa & Tziafa, 2013, p. 3). The 
time period covered by the corpus spans over six centuries, from the 15th to 
21st century. The texts under study are instances of different domain-specific 
registers, so that students may compare the results and the use of each word or 
phrase in different contexts. The corpus consists of a fiction and a non-fiction part 
of 720,282 aligned sentences. 


Figure 1. The SOURCe project’s home page 
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In the following sections we focus on the construction and composition of the 
Exercise tool, based on a parallel corpus, “the content, annotation, encoding 
and availability of which are meant to serve the needs of teachers and students 
of French or Greek as a foreign language and also to facilitate future linguistic 
research” (Kakoyianni-Doa & Tziafa, 2013, p. 1). Moreover, we outline its future 
perspectives and applications. 


2. Method 

2.1. The Source Corpus as a basis 

Following Kakoyianni-Doa and Tziafa (2013) methodology, the core of the 
project is a collection of parallel corpora, either already existing or created by the 
participating researchers, and aligned (at sentence level) original and translated 
texts, in French and Greek. The corpus development is an ongoing process, with 
new texts constantly added. According to previous research, “the use of corpora in 
the classroom can have remarkable results as regards foreign language learning” 
(Kakoyianni-Doa & Tziafa, 2013, p. 2; see also Fladley, 2002). Moreover, as 
Kilgarriff (2009) suggests, parallel corpora are easier to be disguised as dictionaries 
and be brought for use in the classroom. The corpus consists of different registers 
(Biber, 1993), in order to facilitate comparison of the results and to study the use 
of each word or phrase in a different context (e.g. literature, scientific, official, 
technical and journalistic language). Commonly used parallel corpora, mainly 
EUROPARL (Koehn, 2005) and the JRC Acquis corpus (Steinberger et ah, 2006) 
from the Opus open parallel corpus (Tiedemann, 2012) were also used, as were 
literary works available from Project Gutenberg, or scanned, mainly from the local 
historical library Severeios. 

2.2. The Exercise tool construction 

In order to support the use of corpus linguistic tools by teachers and learners with 
no previous expertise, we designed a simple interface through which the user may 
search existing corpora, upload texts, and work online with interactive exercises. 
The Exercise tool enables teachers to create either online activities or print out 
paper-based worksheets, including a variety of texts and activities on topics, in a 
variety of exercise types (e.g. multiple choice, word, phrase or sentence matching, 
filling the gaps with missing words/phrases, text reconstruction, listening, etc.). 
Throughout the SOURCe project, and especially in the Exercise tool, we used Java 
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(Enterprise Edition) for the backend and HTML5, CSS3 and Javascript for the 
frontend and Apache Solr for indexing, searching and sentence fetching based on 
a given similarity distance (used in the multiple choice exercise for the automated 
text selection feature, presented in the next section). 


3. The Exercise tool 


On the main page of the tool (Figure 2) there is a table listing the existing exercises 
and four buttons to create a new exercise (if the user is a teacher or administrator) 
or to filter the listed exercises in the table according to the exercise type (if the user 
is a student). 


Figure 2. The exercises page (from the teacher homepage) 


Welcome Beni 


Library Synonyms Exercises Slabs lies Contact 


^exercises 


Xj 2J 


D — 
□ — 
□ — 


Fill the Gap Mix & Match Jumble Word Multiple Choice 

Available Exercises 


ID* Type Title 

67 nilTheGap Completez les mots manquants: 

68 jumbleWordPuzzle Put the words In the correct order to lorm a sentence. 

71 mlxAndMatch The following sentences are mixed up, put them in the c 

72 multipleChoice Choose one or more correct translations. 


Created By 

Tziafa Elenl 


© 


All the exercises offer (1) a common construction interface to provide the title 
of the exercise (in Greek and French), (2) a description, which is available only 
to the creator of the exercise, to take notes about the specific exercise, and (3) an 
automated text selection feature, which automatically fetches text from the parallel 
corpora collection, based on the user selection. The difference in the common 
automated text selection interface is that in the multiple choice exercise the 
teacher can select the number of suggested returned translations of every sentence 
based on a distance metric provided by the Apache Solr tool. The user can edit 
the automatically fetched text of the exercise or provide the text manually with a 
simple interface. All the exercises can be combined with an audio file, to produce a 
listening exercise. The user selects an MP3, OGG or WAV audio file and the number 


211 













Fryni Kakoyianni-Doa, Eleni Tziafa, and Athanasios Naskos 


of the allowed replays. The exercises can be solved either online or be given as a 
printout (even in cases that an audio file is attached, in order to accompany the 
audio file played in classroom). The combinations are innumerable. We can edit 
the French part, the Greek part or both, thus providing scalable difficulty levels. 


When students are solving the exercise, they are able to check the results or have 
the solution displayed (Figure 3). 


Figure 3. Solution display when the student solves a jumble words puzzle 



4. Conclusions 

In this paper we have presented the latest tool of the SOURCe project, the Exercise 
tool, which offers to French language teachers a friendly interface for online or 
printout exercise creation, and to students an online platform for practice. There 
are plenty of online exercise generators available, but they apply mostly in high- 
resourced languages, like English, in monolingual texts, and most of them are not 
free. There are very few proposals which apply on other languages (e.g. Swedish: 
Volodina & Borin, 2012). 

Unlike other tools, the Exercise tool supports the low-resourced French and 
Greek languages in aligned texts. Moreover, it offers an online practice platform 
for students solving exercises online and checking their results in an automated 
manner. Finally, it is offered freely (registration required) and its source code and 
its assets are available under the Creative Commons license. 

Our future plans include the addition of more types of texts and also exercises, along 
with experimental evaluations and questionnaires, in order to testify the attitude of 
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users toward the provided tools and also encourage teachers and students to use 
these resources in the classroom or beyond. 

Our objective is to develop a whole platform of tools that will assist teachers to 
find out about, adapt and apply new tools in the classroom. To overcome the well- 
known problem of the existing natural language processing tools and resources not 
actually being included in the language learning procedure, despite their potential 
as learning and research tools, the main goal of the proposed project is to provide 
language instructors and learners with ready-made corpora and corpus-based 
exercises, available for use in a new learning environment. The platform provides 
innovative corpus-based learning activities and interactive exercises. This study 
could also serve as a pilot study for the creation of multilingual resources in the 
form of parallel corpora. This project is thus intended not only to fill a gap in the 
literature on corpora used in the classroom, but also to make available valuable 
resources, especially for a low resourced language such as Greek. 
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apprenticeship projects at a university 
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Abstract. The purpose of this study is to examine the impact of a hybrid 
apprenticeship model in the context of university level English education in Japan. 
The focus is on freshman perceptions and attitudes toward their English learning. 
For this study, seniors were asked to create brief videos in English sharing study 
strategies, helpful student life tips, and advice regarding study abroad programs. 
The study examined (1) the improvement of the freshmen’s smartphone video 
assignments before and after they viewed the seniors’ videos discussed above, and 
(2) pre- and post-questionnaires with four Likert-scale items and one open question. 
These results show that the apprenticeship videos can not only serve as modeling but 
also foster scaffolding outside of the classroom. 

Keywords: apprenticeship, university, Japan, smartphone. 


1. introduction 

Throughout history, apprenticeship has been a primary mechanism for teaching 
and learning. However, in Japanese universities, the apprenticeship model, in 
the context of English education, has been difficult for three primary reasons. In 
general, Japanese young adults over age 25 generally do not attend universities. 
Recent statistics show no more than 1.9% of Japanese university students are 
over 25 years old, which is low compared to the world average (19.6%) (MEXT, 
2011; OECD, 2014). Thus, there is a statistical shortage of‘mentor’ students who 
have accumulated enough life experience to provide more meaningful tutelage to 
younger students. Furthermore, new students often do not have opportunities to 
make strong connections with more senior students. Individual English classes are 
generally comprised of students at the same education level, so freshmen are not 
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likely to mix with seniors in the course of regular class activities. Thus, vertical 
connections between different class years are improbable. 

Finally, when newer students have chances to interact with older students, they may 
hesitate to ask for advice. This may be traceable to traditional Japanese societal 
paradigms, which assign roles of superiority and inferiority to senior and junior 
positions, respectively (Mosk, 2007). In addition, in English as a foreign language 
settings like Japan, it can be hard to find a role model. In many cases, teachers who 
are native English speakers are likely to become students’ role models. However, 
this is not always beneficial, according to Vygotsky’s (1978) zone of proximal 
development. If the role model is too far removed from the learner, in terms of 
skills, the learners may lose their motivation. Murphey (1998) recommends that for 
the purpose of modelling, we focus on various desirable attitudes and practices of 
some “lesser gods, closer to home” such as the students’ “Near Peer Role Models” 
(NPRMs)” (p. 202). 

2. Literature review 

Examining NPRMs (Murphey & Arao, 2001) provides useful information for this 
study. Murphey and Arao (2001) defines NPRMs as “peers who are close to one’s 
social professional, and/or age level, and whom one may respect and admire” 
(p. 2). Long and Porter (1986) examined the language produced by adult learners 
whose first language was Spanish. Intermediate learners talked with a speaker from 
each of the three levels: intermediate, advanced, and native speaker of English. 
They found that the learners talked most with advanced level speakers. This means 
that an apprenticeship relationship may be most effective if the ability gap between 
the mentor and the learner is not too wide. The study of Choi and Ishiwata (2016) 
found that in Australia, adult low pro-proficiency learners of English had greater 
language learning success when they were grouped with high-proficiency learners 
as opposed to other low-proficiency learners. 


3. Method 

3.1. Participants 

The participants of this study were 28 freshmen in an English class at a university in 
the Kanto area (16 male students and 12 female students). Their collective English 
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level was B1 according to the Common European Framework of Reference for 
languages (CEFR). All of them were non-English majors and taught by a Japanese 
teacher who used both English and Japanese in class. The class was held once a 
week for three months (90 minutes per class session). 

3.2. Procedures 

For the study’s mentors, I asked a successful second-year class (CEFR B2-C1) 
consisting of ten students (four male and six female students) to participate in this 
study. I explained to them that their learning techniques and university survival 
skills would be accessed and leveraged to help freshmen. I asked them to discuss 
their experiences and decide upon one topic individually, avoiding overlaps. They 
created brief instructional videos using their own smartphones. The length of each 
video was about one minute. The topics were: 

• How to effectively use time. 

• How to find opportunities to use English outside of class. 

• How to stay in good physical shape. 

• What my first year schedule looked like. 

• How club activities help me. 

• Why it is important to join university union projects. 

• What part-time job or internship I did. 

• How I improved my English. 

• How I improve my test scores. 

• What classes I took. 

3.3. Questionnaire 

At the first class the freshmen responded to the pre-questionnaires. The questionnaire 
items were adopted from Murphey and Arao (2001). About one month later, these 
freshmen watched the videos created by seniors and posted their opinions on 
our closed webpage in either Japanese or English. They also answered the post¬ 
questionnaire. The pre- and post-questionnaires featured the same elements with 
a five point Likert Scale (l=Strongly disagree, 2=disagree, 3=neither agree nor 
disagree, 4=agree, and strongly agree), followed by an open question. 

• Making mistakes in English is OK. 

• It is good to have goals in learning English. 

• Speaking English is fun. 

• Japanese can become good speakers of English. 
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• What did you learn from the seniors’ videos? 


4. Results 

First, the scores of the questionnaire items increased across the board after the 
freshmen viewed the mentoring videos (Table 1). Second, in particular, those 
who did not have prior successful English learning experiences, or who had low 
confidence, showed greater positivity in terms of responses. Third, the freshmen’s 
videos were more creative and more relatable to their daily life. 

The online comments posted on our closed website were basically short, such 
as “Great!”, “Cool!” and “I want to speak like them”. These comments were in 
keeping with the results from Murphey and Arao’s (2001) study. There were no 
comments regarding the content, including further questions about learning skills 
or strategies. 

When I asked the apprentice group of younger students to write follow-up questions 
to the mentoring seniors, they wrote questions such as the following (in Japanese): 

• What kind of practice do 1 need? 

• How did you improve your pronunciation? 

• What practice do you usually do at home? 

• How much did you study English? 


Table 1. The mean ratings before and after the freshmen viewed the seniors’ 
video 



before 

after 

1. Making mistakes in English is O.K. 

3.8 

4.2* 

2. It’s good to have goals in learning English. 

3.7 

4.5** 

3. Speaking English is fun. 

3.2 

3 7 ** 

4. Japanese can become good speakers of English. 

3.7 

4.1* 


*significant changes at p<0.05, ** significant changes at p<0.01 

In response to the open question: What did you learn from the seniors ’videos?, the 
freshmen did not mention the ‘academic’ content of the mentoring videos (such as 
learning skills or strategies). The apprentice students were instead focused on the 
presentation aspects of the instructional videos. Responses included: 

“I think I should speak faster”. 
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“Seniors used easier vocabulary than I thought. I always thought 1 needed 
to use difficult words, but I think easy words should be better and more 
understandable”. 

“I cannot believe the length of the presentation in the video was only 
around one minute. There was a lot of content even though it was only 
one minute”. 

The study protocol included freshmen preparing their own videos. In their first 
videos, they were likely to read from pre-prepared scripts and be quite short. 
However, after watching the seniors’ mentoring videos, freshmen’s confidence 
appeared to increase, and they were inclined to speak in more impromptu and 
creative ways. 

After this study, I created an opportunity for the freshmen and the sophomores 
to meet face-to-face at a luncheon. Five sophomore ‘mentor’ students and nine 
freshmen participated. My observations included the following: (1) both freshmen 
and sophomores willingly helped each other, (2) they talked about the video 
content, and further asked about it in Japanese, and (3) the sophomore students 
were very proud of themselves. 


5. Conclusions 

The study established the following three points: first, it is very useful to provide 
video apprenticeship features for newer students. Second, structured apprenticeship 
programs, such as the smartphone video apprenticeship program used in the study 
are helpful in fostering the apprenticeship model. Without this kind of structured 
interaction, it can be rare for freshmen to have opportunities to meet older students 
at universities in Japanese English class. Third, as observed in NPRMs (Murphy, 
1996), a one or two-year gap between student groups is suitable. Based on my 
observations throughout the study, the freshmen’s awareness of the fact that 
successful mentor students were only one year older appeared to be a factor in 
engendering confidence in the younger students. 
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The effects of multimodality through 
storytelling using various movie clips 


SoHee Kim 1 


Abstract. This study examines the salient multimodal approaches for communicative 
competence and learners’ reactions through storytelling tasks with three different 
modes: a silent movie clip, a movie clip with only sound effects, and a movie clip 
with sound effects and dialogue. In order to measure different multimodal effects 
and to define better delivery modes, three one-shot commuter-based tests for 
each mode and one survey were conducted. Three tasks were administered on the 
websites specially designed for the study using Flying Popcorn 7.0, a web authoring 
programme. After viewing each movie clip, participants were asked to immediately 
record a one-minute story. There were 90 Korean English learners who attended 
academic English classes at a university located in South Korea. The results showed 
that there was a significant difference in their speaking performance when using the 
movie clip with sound effects and dialogue. In the survey, participants responded 
that the movie clip with sound effects and dialogue provided a good way to assess 
speaking and listening within a given time frame. 

Keywords: storytelling, multimodal learning, media effects, speaking assessment. 

1. introduction 

Multimodality can refer to a new form of communication that provides learning 
experiences for language learners. It is composed of more than one medium and 
is defined as the learner’s use of more than one sense (Mayer & Sims, 1994). 
Multimodal modes include more than language, enabling language learners to 
perceive and understand differently, based on their language proficiency and their 
cognitive processes used to interpret media. Moreover, using a variety of modes 
can also lead to the development of integration skills, allowing language learners 
to interpret multiple modes simultaneously. In order to investigate multimodal 
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effects, this study used different movie clips for a storytelling task on computer- 
based tests to find salient media effects. Since using a movie clip draws attention 
for active viewing, encourages discussion among language learners, and develops 
opinions and literature skills (Kim, 2014; Scheibe & Rogow, 2008), a storytelling 
task with a movie clip can be an effective medium to assess language learners’ 
media effects. This study explores how English learners interact differently with 
media, a movie clip, and attitudes towards different modes. 


2. Method 

2.1. Participants 

The participants in the present study were 90 university students (53.3% male, 
7?=48; 46.7% female, 77=42) who attended academic English classes to fulfill their 
graduation requirements in South Korea. There were 59 freshmen, 25 sophomores, 
four juniors, and two seniors. The Test of English for International Communication 
(TOEIC) scores ranged from 325 to 940. Overall, they had studied English in 
Korea between two and 16 years and had studied in English-speaking countries 
between zero and five years. 

2.2. Research questions 

This research explores the impact of effective media learning environments on 
the development of oral proficiency, as well as exploring guidelines for language 
teachers for effective learning through media teaching. To address this, the study 
had the following two research questions: (1) How does the participants’ speaking 
performance differ relative to the three various modes through storytelling? 
(2) What specific interactions are related to the three different modes for oral 
performance? 

2.3. Materials and methods 

This study investigates the language learners’ attitudes towards different modes 
and speaking performances through storytelling on three online computer-based 
tests. After viewing each movie clip, participants were asked to record a one- 
minute story based on what they had seen. Three tests were developed using the 
Flying Popcorn 7.0 web software programme that allows test-takers to record oral 
performance for the movie clip task and saves their recorded files on the computer. 
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All participants were required to write their names on the first screen and then they 
were able to watch each movie clip in order to record their stories. 

The first task used the movie clip with sound effects: Charlie Chaplin’s ‘The 
Coffee’. The second task featured the silent movie clip: Charlie Chaplin’s ‘Hotel 
Evergreen’. The last task used the movie clip with sound effects and dialogue, 
‘Turbo Diner’ from the Wallace and Gromit movie. All the movie clips were under 
two minutes long. 

The participants’ oral proficiency was assessed holistically and analytically with 
four criteria: discourse, vocabulary, grammar, and sentence complexity. The 
Common European Framework of Reference (CEFR) scores from one to six were 
used as the holistic rubric. The analytical rubric was based on the Communicative 
Language Ability (CLA) model and was adapted into four categories in order to 
measure discourse, vocabulary, grammar, and sentence complexity (Kim, 2014). 
Each category is scored from one to five. T-tests, ANOVA and Chi-Square tests 
were used to examine recording and questionnaire data. Participants’ TOEIC 
listening comprehension scores were compared with speaking performance in 
order to determine if there were any differences for the three modes. 


3. Results and discussion 

Three native speakers - two British and one American - assessed participants’ oral 
performance, and the inter-rater reliability of Cohen’s Kappa coefficient was .885. 
The results revealed that Task 3, Task 2, and Task 1 had higher scores respectively 
on both the holistic and discourse scores. In line with this, there were significant 
differences for holistic scores between Task 1 and Task 3 (/;<().05) and discourse 
scores between Task 1 and Task 2 (y><0.05), as well as between Task 1 and Task 3 
QK0.05). 

Moreover, there was no significant difference between participants’ preferences or 
level of difficulty in their speaking performance relative to the three movie clips 
when creating a story. There was, however, significant difference between how 
easy participants founded the tasks and their speaking performance (/;<(). 05) as 
well as grammar scores (/;<().05) for Task 3. 

In the survey, participants answered that Task 3 was a good test to assess their 
listening and speaking skills over a short time period. They also felt that a movie 
clip without dialogue can offer freedom to make a story. 
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4. Conclusions 

This study concluded that the participants’ oral performance was substantially 
different for holistic and discourse scores for the three tests. Moreover, they had 
different interpretations towards different modes. 

This study investigated multimodal effects through storytelling with various media 
modes for oral proficiency, but a longevity study with different types of movie clips 
and an investigation of learners’ preference for various movie clips for storytelling 
still need to be conducted for media literacy. 
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of writing and speaking skills in ESP courses 
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Abstract. There has been a growing interest in incorporating social media in 
education and in language teaching in general. From a pedagogical perspective, 
as mentioned in Kleanthous (2016), blogs (or weblogs) appear to be effective in 
enhancing writing and/or reading skills, as their interactive platforms enable 
learners to exchange comments and offer feedback to each other, thus allowing 
learners to reflect on their own work and the learning process. Following our 
previous research (Kleanthous, 2016), this study proposes a research agenda for 
the effectiveness of collaboration through peer feedback in order to enhance the 
writing and speaking skills of English for Specific Purposes (ESP) students in online 
settings. A preliminary analysis of data collected suggests that the interactive use of 
blogs in the ESP classroom has a positive impact on students’ writing and speaking 
skills. The discussion of our results highlights the importance of social media in 
promoting language learning within a collaborative environment that is essentially 
learner-centered and teacher facilitated, as recommended by Computer-Assisted 
Language Learning (CALL) researchers (e.g. Chapelle, 2001). 

Keywords: blogs, collaborative learning, peer feedback, social media. 


1. Introduction 

Collaboration among students is believed to be beneficial because it encourages 
them to become motivated and engaged in the learning process, as attested by 
recent research. For example, Fernandez Dobao (2012) investigated the effect 
of pair and group work in written accuracy, fluency and complexity, as well as 
the frequency and nature of language related episodes. Fler study indicated that 
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collaboration, either in pairs or in small groups, produced more grammatically and 
lexically accurate written materials. 

Similarly, collaborative assessment in e-learning environments suggests that 
active collaboration among students makes them more motivated and engaged in 
the process of learning (McConnell, 2002). Knowing that there is an audience of 
readers or listeners seems to make students more motivated and, accordingly, they 
are more willing to put effort into assigned activities and thus do their best to 
perform well. Providing and receiving feedback by both their peers and instructor 
via this collaborative process can also be beneficial, especially in improving the 
students’ writing and speaking skills, and their overall language development. 

The focus of this paper is on the productive skills of writing and speaking because 
these are more easily implemented in a blog environment due to its message posting 
features. This paper is part of the first author’s PhD research, and it aims to set out 
a research agenda for the effectiveness of collaboration through peer feedback in 
order to enhance the writing and speaking skills of ESP students in online settings. 
As such, the study aims to answer the following two research questions: (1) what 
impact does the use of blogs have on written and spoken language development in 
ESP contexts?, and (2) what are the students’ perceptions on whether collaboration 
through peer feedback helps improve personal writing and speaking skills in ESP? 


2. Method 

2.1. Participants 

43 first-year Computer Science undergraduate students at the University of Cyprus 
participated in this study. They were 19 to 22 year old Cypriots enrolled in the 
compulsory English for Computer Science course. 

2.2. Procedure and instruments 

The instructor/researcher created a class blog using Blogger (www.blogger.com) 
in which students became both followers and authors. Two writing tasks and two 
speaking tasks were uploaded throughout the semester. Students had to complete 
each task by a specific deadline and then comment on each other’s posts as a follow¬ 
up activity after each task. The instructor monitored all comments and facilitated 
the discussion if some comments were not clear. 
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In general, students offered more comments related to the content, format and 
style of the written tasks, and less on correcting grammar, vocabulary and spelling 
errors. With respect to the speaking tasks, students provided oral comments 
expressing agreement/disagreement or personal views on the specific task at hand. 
These recordings were conducted using Vocaroo (www.vocaroo.com), in the form 
of podcasts, which were then uploaded to the course blog for peer feedback. 

2.3. Data collection 

The methods used to answer the two research questions included the collection of 
qualitative data such as writing samples from the learners’ blog. Apart from their 
own posts, learners were encouraged to comment on their classmates’ work by 
giving constructive feedback based on a set of pre-established criteria. By using 
their peers’ feedback, students had to revise their assignments and upload the final 
drafts so that the instructor coidd evaluate them. 

Following the students’ initial posts, seven volunteers were interviewed in two focus- 
group sessions in which they were asked to report and answer questions about their 
perceptions and attitudes towards the use of blogs, as conceptualized in the study. 
The same number of students was interviewed again in the same focus groups at the 
end of the semester, after they had completed all blog-related assignments. Finally, 
participants were interviewed individually at the end of the study. 


3. Results and discussion 

With respect to the impact of blogs on the development of the students’ writing and 
speaking skills in an ESP course, an analysis of the data, which included extracts 
from blog posts and comments, reveals a perceived improvement in the students’ 
performance, especially in writing. A comparison was made between the blog posts 
and their comments (which constituted their first attempt at writing a memo on 
the blog), against their performance in the subsequent memo assignment, midterm 
and final exams. The participants’ writing mistakes noted on the first task were not 
repeated in subsequent exams and they further improved their memo-writing skills. 
Regarding the students’ speaking skills, due to students’ hesitation to record their 
own speech and upload it to the blog, only one third of the students performed these 
tasks, therefore additional data need to be gathered to draw reliable conclusions. 

An analysis of the data also revealed the students’ positive attitudes towards the 
use of blogs for improving their writing skills. They felt it was an innovative 
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and interesting way to do their homework: “interesting, a different way to give 
my papers and get in contact with my teacher; [...] helpful; reading others’ 
posts helps understand the task better if 1 have difficulty”. They also stated that 
the interactive feature blogs, through which they could exchange feedback on 
their work, helped them improve their writing, and made them pay attention 
to their peers’ comments. Some participants stated that “getting comments is 
motivational; I didn’t repeat the mistake; it’s more helpful to the instructor’s 
comments because you just read the teacher’s comments and forget them, but 
your classmates’ comments you cannot forget”. Even though some participants 
felt uncomfortable giving comments and feedback to peers, as they felt that their 
classmates might be offended, they recognized in the end that by identifying 
errors in their classmates’ work, they helped each other identify errors in their 
own writing, and this prevented them from making the same mistakes again: 
“1 felt good about giving comments because 1 felt I was helping someone get 
better and it helped me express myself when I commented on others’ work and 
it improved my writing as well”. They also stated that using the blog positively 
affected their motivation, as they would constantly log in to check whether 
someone had posted a comment on their writing or speaking tasks. 

With regards to the participants’ speaking tasks, they stated that using Vocaroo was 
easy, and that completing the tasks did not take a considerable amount of extra time. 
However, some felt nervous about recording their voice and sharing it with their 
classmates, since it was something they had never done before. Finally, according 
to their responses, speaking tasks that take place on a blog may be more helpful 
for preparing a presentation, since they can be rehearsed before they are recorded: 
“[blogs] improved my speaking skills mostly because I had to record myself, tried 
more than once to have a good result [...]; similar to giving a presentation, so 
I practiced that skill”. 

4. Conclusion 

To conclude, the results reported here reveal that the participants perceive blogs as 
important tools to promote language learning within a collaborative environment 
that is essentially learner-centered and teacher-facilitated, as recommended 
by CALL researchers (Chapelle, 2001). In particular, participants felt that they 
improved in their writing, speaking and reading skills, especially through the 
exchange of feedback, although they felt hesitant and anxious about recording and 
sharing their own speech. Finally, they perceived blogs as motivating and fun tools 
that enhanced their overall language learning experience. 
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Abstract. The purpose of this contribution is to share reflections and practices in 
cultivating a community of learners in the context of a professional development 
programme at Master’s level for language teachers. The programme implements 
a highly participatory pedagogical model of online learning which combines the 
Community of Inquiry (Col) model (Garrison, Anderson, & Archer, 1999) with 
the Community Indicator Framework (CIF) (Galley, Conole, & Alevizou, 2012). 
The tangible outcome of our revised interpretation of the two models is a cohesive 
community characterised by a strong sense of commitment towards the learning of 
the individuals as well as that of the group. This affects the quality of the learning 
experience, enhances academic achievements, and increases student retention. 

Keywords: online community, language teachers, distance learning. 


1. Introduction 

Online and distance learning is increasingly used in teacher education programmes 
since it affords access to course materials anytime/anywhere, participation from 
disperse geographical locations, and a flexible schedule. At the same time, it faces 
a number of challenges such as effective use of technology, students’ personal 
commitments affecting engagement with the course, and students’ feelings of 
isolation affecting their participation. 

The Master of Arts in Digital Technologies for Language Teaching (MA in 
DTLT), University of Nottingham, is a two-year part-time online distance learning 


1. University of Nottingham, Nottingham, United Kingdom; Angelos.Konstantinidis@nottingham.ac.uk 

2. University of Nottingham, Nottingham, United Kingdom; Cecilia.Goria@nottingham.ac.uk 

How to cite this article: Konstantinidis, A., & Goria, C. (2016). Cultivating a community of learners in a distance 
learning postgraduate course for language professionals. In S. Papadima-Sophocleous, L. Bradley & S. Thouesny 
(Eds), CALL communities and culture - short papers from EUROCALL 2016 (pp. 230-236). Research-publishing.net. 
https://doi.org/10.14705/rpnet.2016.eurocall2016.567 


230 


© 2016 Angelos Konstantinidis and Cecilia Goria (CC BY-NC-ND 4.0) 




Cultivating a community of learners in a distance learning postgraduate course... 


programme that targets qualified teachers interested in developing their theoretical 
and practical expertise in the field of digital technologies with a specific focus 
on the learning and teaching of foreign languages. The programme addresses 
the aforementioned challenges by leveraging course design as well as a series 
of Web 2.0 tools to cultivate a strong sense of learners’ community and increase 
students’ commitment to the programme. 

In the following section we present the development of our pedagogical framework 
and reflect on its design. Next, we briefly discuss its implementation and, lastly, we 
list the most important outcomes. 


2. The development of our framework 

In creating our framework for designing and implementing the programme, 
we laid two cornerstones. The first is the Col by Garrison et al. (1999). The 
Col posits that valuable educational experiences are embedded within a Col 
consisted of teachers and students, where learning occurs through the interaction 
of three core elements, namely cognitive presence, the extent that participants are 
in position to construct meaning through communication; social presence, the 
participants’ ability to project their socioemotional traits into the community; and 
teaching presence, which relates to the design and facilitation of the educational 
experience. 

Our second cornerstone is the CIF by Galley et al. (2012), a tool for monitoring, 
observing and supporting collaborative activities in online communities of practice. 
The CIF identifies four fundamental aspects of experience: participation, the ways 
in which individuals engage in activity; cohesion, the ties between individuals and 
the community as a whole; identity, how individuals perceive the community and 
their place within it; and creative capability, the ability of the community to create 
shared artefacts and knowledge (Goria & Lagares, 2015, p. 224). 

Col and CIF differ in two ways. Firstly, Col provides a framework for computer 
mediated communication for closed educational settings, while CIF is informed 
by the principles of open education and focuses on open social networks for 
education professionals. Secondly, Col supports purposely designed educational 
experiences, while CIF supports community development in an open social network 
site. Given that the MA in the DTLT programme sits within an institutionally 
closed online educational context and yet employs open pedagogies based on the 
wider social web and its students’ online communities, we attempted to reconcile 
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the two models to develop a framework (Figure 1) for monitoring and supporting 
the development of our learning community. What follows is a brief description 
of this process. 

Figure 1. ‘Learning in online communities’ framework adapted from Col and CIF 



Firstly, we associated social presence with identity since both are related to the 
social characteristics of a community. Next, we placed cohesion along with 
teaching presence, since we believe it is a primary function of the teacher to 
establish ties between members. We placed creative capability in the cognitive 
sphere, since it is related to the ability of the community to engage in productive 
activities. Lastly, we positioned participation in the centre since it is related to 
the whole operation of the community. 

We included participants’ Personal Learning Networks (PLNs) into the model for 
three reasons. Firstly, each participant’s PLN is significantly enhanced through his/ 
her participation to the programme. Secondly, learning outputs of each participant’s 
PLN affects the learning experience of the community. Thirdly, the pedagogical 
approach implemented with our programme actively scaffolds the development of 
our students’ PLNs. Flence, there is a reciprocal exchange between each student’s 
PLN and the community. We considered that such a relation would best be 
illustrated by drawing a surrounding circle that encapsidates the community and 
its participants. 
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3. Implementation of the framework 

3.1. Social presence 

Three methods are employed for enhancing social presence: 

• Welcoming new students. Part of our induction process, we invite new 
students to join a closed group and engage them in a series of warm-up 
activities. 

• Celebrating social events. We use various web tools and ways to celebrate 
social events in which our students are invited to participate. 

• Synchronous meetings. We schedule online synchronous meetings 
regularly. 

3.2. Identity 

We employ four methods to promote group identity: 

• Addressing students as a group. We cultivate a culture of shared 
responsibility in studying and doing the activities. 

• Peer-feedback. We constantly encourage peer-feedback. 

• Group tasks. During each year students have to complete at least one 
group task. 

• Dissertation Show. Every summer all community members are invited to 
the dissertation show, an online event where second-year students present 
ongoing work on dissertations. Since dissertations are the most important 
assignments that students undertake, this event helps them feel that they 
are all in the same boat. 

3.3. Cognitive presence 

We followed the critical inquiry model (Garrison et al., 1999) in the design and 

implementation of our overall strategy and the individual learning tasks to enhance 

cognitive presence: 
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• Triggering event. Integration of web tools in the activities positively 
affects their reception from students. 

• Exploration phase. Students are encouraged to employ their PLN in their 
quest for information. 

• Integration and resolution phases. We design tasks that challenge students 
to step out from the exploration phase and reach the integration and 
subsequently the resolution phases. 

3.4. Creative presence 

The focus of our efforts is on ways of establishing a conducive context for creative 
processes. Our strategy is built on four pillars: 

• Spirit of collaboration. This is not to suggest that creativity can only be 
expressed through collaborative practices, rather that members should 
sense that there is a shared goal and that reaching this goal necessitates 
collaborating with others instead of antagonising. 

• Spirit of openness. We hold that open education can be realised in many 
ways. One of these ways is to cultivate the identity of ‘open scholar’ to the 
members of the community (Weller, 2012). Indeed, our community members 
develop most of the practices described as the characteristics of open scholar. 

• Spirit of problem-based learning. Rather than lecturing about the weekly 
topics, we prepare tasks that resemble real-world problems. 

• Spirit of technology integration. We consider technology integration 
important for a number of reasons, such as authenticity in tasks, 
collaboration, etc. 

3.5. Teaching presence 

The role of the teacher can be acquired by any community member, so the 
following ways of establishing teaching presence should be approached with this 
premise in mind: 

• Peer interaction. We encourage peer-to-peer interaction since it is the 
first step for adopting teacher’s role by students. Accordingly, use of 
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different platforms that we support in the programme provides multiple 
opportunities for interaction. 

• Shifting roles. We actively encourage students to acquire the role of the 
teacher in several occasions (i.e. sharing expertise). 

3.6. Cohesion 

We consider group cohesion not as something static, but rather as constantly evolving 
and changing depending on the member who acquires the role of the teacher at any 
given moment. Although this may seem challenging in maintaining a coherent 
community, we employ the following strategies to cultivate a cohesive atmosphere: 

• Non-hierarchical relations. We establish a mutual relationship with tutors 
and students alike. The use of the inclusive ‘we’ is a feature of the way 
groups are addressed. 

• Casual language and environments. We eschew formalities both in 
language and in online environments. 

• Self-disclosure. Self-disclosure helps members to build friendly relations. 
We facilitate self-disclosure through online social games. 

4. Outcomes 

The tangible outcome of our revised interpretation of the two models is an active 
and cohesive community characterised by a strong sense of commitment towards 
the learning of the individuals as well as that of the group. This affects the quality 
of the learning experience, enhances academic achievements, and increases 
student retention. 


5. Conclusion 

In this paper we discussed and reflected on the development of the pedagogical 
framework for cultivating an online community of learners at the online distance 
learning MA in DTLT. We presented an array of strategies that we employ and we 
consider important for the success of the framework. We perceive that the proposed 
framework offers to our programme, as well as to other educators who organise 
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and facilitate similar online courses, a valuable tool to monitor and support the 
development of a learning community. 
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Abstract. This paper introduces a Dialog-Based Computer Assisted second- 
Language Learning (DB-CALL) system using task-oriented dialogue processing 
technology. The system promotes dialogue with a second-language learner for 
a specific task, such as purchasing tour tickets, ordering food, passing through 
immigration, etc. The dialog system plays a role of a ticket agent, a waiter, or an 
immigration officer at each task and the learner completes the task through talking 
with the system in the second-languages. The system gives a new situation of the task 
at every trial, so that the learner could have a different experience and learn various 
expressions in the same task. Our DB-CALL system is based on a task-oriented 
dialog system consisting of a language understanding module using a structural 
support vector model and a dynamic dialog graph based dialog management module. 
Our task-oriented dialog system is trained from the intention-annotated real dialog 
scripts. The experiments for the perfonuance of our proposed dialog system show 
the average task success rate of 85.52%, the average turn success rate of 85.32%, 
and the average turn length of 14.61. In a satisfactory survey targeting the subjects, 
the subjects agreed that our system makes them learn the second-language more 
efficiently and with less effort. 

Keywords: computer-assisted second-language learning system, dialog-based 
CALL, task-oriented dialog system, language understanding, dynamic dialog graph 
based dialog management. 


1. introduction 


Many methods from the field of natural language processing and dialog processing 
have been employed in CALL (Johnson & Valente, 2009; Kwon, Lee, Kim, & Lee, 
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2015; Wilske, 2015). The approaches engage the learner in a dialog and provide 
educational feedback, focusing on either form-based instruction or meaning-based 
instruction. Focus-on-form approaches tend to allow for relatively constrained 
input to provide more explicit feedback of linguistic forms and formal correctness 
about the learner’s utterance (Kwon et al., 2015), whereas focus-on-meaning 
approaches tend to allow the learner to freely speak for providing opportunities 
for communication in the real world, but provide the less informative feedback 
(Wilske, 2015). 

In this paper, we introduce a task-oriented spoken dialog system for providing 
the opportunities to use English in a situation that is similar to situations in real- 
life. A task-focused CALL system gives learners rich and realistic opportunities to 
practice achieving those tasks (Johnson & Valente, 2009). Our task-oriented spoken 
dialog system allows the learners to speak freely without a fixed scenario in a given 
task, then the learners can change the system initiative dialogue to their initiative 
dialogue. Our system provides no grammatical feedback and only provides the 
next recommended utterances for the learners after each system response. The 
proposed DB-CALL system focuses on meaning-based second language learning 
for the learners being familiar with English forms. 


2. Task-oriented spoken dialog system 
for second-language learning 

The system consists of Automatic Speech Recognition (ASR), task-oriented dialog 
processing, and Text-To-Speech (TTS) as shown in Figure 1. The ASR is optimized 
to recognize the English utterances of Korean learners as well as native speakers’ 
utterances (Kwon et al., 2015) using a commercial English TTS engine to generate 
voices from system responses. 

Our task-oriented dialog processing consists of a language understanding module 
using a Structural Support Vector Model (SSVM) (Lee & Jang, 2009) and a dynamic 
dialog graph based dialog management module. Our task-oriented dialog system uses 
the knowledge, which is trained from intention-annotated dialog scripts. Every dialog 
script is a real dialog between two persons who play a role of native (system) and 
learner (user) to accomplish the predefined task goal. We annotated every system and 
learner utterance with its intention using predefined dialog acts and slots. To classify 
user utterance with the predefined dialog acts and slots, the language understanding 
module trained dialog act classification model and slot classification model from user 
utterances of the intention-annotated corpus using SSVM, respectively. The dialog 
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management model automatically constructs the task-oriented dialog-graph from 
the intention-annotated corpus. The task-oriented dialog-graph consists of user and 
system intention nodes having slot history vectors and direct links between nodes 
with weights. The user and system nodes of the graph corresponds to the user and 
system intention of the dialog scripts. The edges between nodes present the dialog 
flow of the dialog scripts. The dialog management module finds the best user node 
similar to the intention of current user’s utterance in the current dialog history, and 
then selects dynamically one among the system nodes linked by the best user node 
according to the level of difficulty for learning. We define the longer the length of 
dialogue is, the more difficult the level. Therefore, the management selects the system 
node on the shorter path into the terminal nodes when the level is easier. The dialog 
management module generates system responses using the example sentence of the 
selected system node. The management module memorizes the used frequency of 
each node during communication with a learner and selects the system node having 
the least frequency to provide the learner new situations. 

Figure 1. Schematic diagram of the proposed task-oriented dialog system for 
second-language learning 


second 

language 

learner 



3. Results and discussion 

For the experiments, we constructed two task-oriented dialog systems, purchasing 
city tour bus tickets and passing through immigration. For each task, we firstly set 
up several situations, next gathered 100 dialog scripts between an English native 
(system) and a Korean English teacher (user), then English natives proofread the 
utterances of Korean teachers. Figure 2 shows an example of dialog script for 
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purchasing city tour bus tickets. Next, we annotated the utterances with system 
or user intentions. Finally, our task-oriented dialog system was trained from the 
intention annotated scripts. 


Figure 2. Example of dialog script for purchasing city tour bus tickets 


Task: Buying city tour bus tickets 

Goal: Buy New York City Bus Tour tickets 

Scenario condition: (1) 1 adult, 1 child (5 years old); (2) Take daytime tour; (3) Get two-day 
ticket; (4) Visit Statue of Liberty; (5) Get 1 audio guide, 1 Korean tour booklet; (6) Spend 
$120 or less 

S 

Hi there. Welcome to the New York City Bus Tour Center. 

U 

I want to buy tickets for me and my child. 

S 

What kind of tour would you like to take? 

U 

We would like to go on a tour during the day. 

S 

We have two daytime tours: the Downtown Tour and the All Around Town Tour. 

U 

Which tour goes to the Statue of Liberty? 

S 

You can visit the Statue of Liberty on either tour. 

U 

Can we get two-day tickets? 

S 

You can get two-day tickets for the All Around Town Tour. 

U 

Do you provide any guide materials? 

S 

We have an audio guide for 10 dollars and free tour booklets. 

U 

Do you have tour booklets in Korean? 

S 

Yes, we have Korean tour booklets. 

U 

How much are tickets for the All Around Town Tour? 

S 

Adult tickets are 60 dollars. 

U 

How much are tickets for children? 

S 

Children 5 years old and under pay 50 dollars. 

U 

Okay. I would like one adult ticket and one child ticket. 

S 

Is your child 5 years old? 

u 

Yes. I would like also an audio guide and a Korean tour booklet. 

s 

Okay. That will be 120 dollars. 

u 

Here you go. 

s 

Thank you. Enjoy the tour. 


To evaluate the performance of the systems, we recruited 20 subjects: Group A 
with low proficiency levels (five subjects with Test of English for International 
Communication (TOEIC) scores lower than 500), Group B with middle proficiency 
levels (ten subjects with TOEIC scores between 500 and 800), and Group C 
with high proficiency levels (five subjects with TOEIC scores higher than 800). 
Each subject had a dialogue with the system to achieve a given mission. In the 
experiments, the subjects tried four missions for each task. If there are ASR errors, 
the subjects corrected the ASR errors by typing to only evaluate our proposed task- 
based dialog processing engine without ASR errors. Table 1 shows the results of 
the experiments. The experiments show the average task success rate of 85.52%, 
the average turn success rate of 85.32%, and the average turn length of 14.61. 
Contrary to our expectations, the success rates of Group C are lower than Group 
A and B. The reason is that the subjects of Group C tried the communication and 
intelligence abilities of the dialog system by speaking various utterances and 
driving the system to an unexpected situation, while the subjects of Group A and B 
made utmost efforts to accomplish their goals. 
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Table 1. The results of the experiments to evaluate the task-oriented dialog 
system 


Measure 

Subject group 

Group A 

Group B 

Group C 

All subjects 

Avg. Task Success Rate (%) 

93.75 

89.90 

72.92 

85.52 

Avg. Turn Success Rate (%) 

86.71 

87.09 

82.17 

85.32 

Avg. Turn Length 

14.71 

13.80 

15.32 

14.61 


We also investigated a satisfactory survey targeting the subjects about the second- 
language usefulness and efficiency. Table 2 shows the survey questionnaires and 
the average satisfactory scores of the subjects. The subjects indicated their level of 
agreement on each of the questionnaires. The levels of agreement are scored from 
one (strongly disagree) to six (strongly agree). From the results of the survey, most 
subjects agreed to that our system helps them learn English more efficiently and 
with less effort. Although the subjects of Group C did not faithfully take part in the 
experiments, the survey gained a better satisfaction score from Group C than those 
of the Group A and B. We assumed the reason is that our proposed task-oriented 
dialog system meets the requirement of the learners with high proficiency levels 
who want to exercise and acquire English through communicating spontaneously 
in authentic social situations. 


Table 2. The results of a satisfactory survey 


Survey questionnaires 

Level of a 

greement (1 through 6) 

Group A 

Group B 

Group C 

All 

Ql) The naturalness of the dialogue 
made the system so true to life. 

4.20 

4.42 

4.63 

4.41 

Q2) The hints and suggestions are 
appropriate for the dialog context. 

4.95 

4.67 

4.75 

4.76 

Q3) The dialog system helps you 
learn English more efficiently. 

4.65 

4.92 

5.13 

4.90 

Q4) The ASR function helps you 
learn English more efficiently. 

5.05 

5.08 

5.38 

5.15 

Q5) The TTS function helps you 
learn English more efficiently. 

4.80 

4.67 

4.63 

4.69 

Q6) The system has some good 
features to help us learn English 
more efficiently and with less effort, 
compared to the previous methods. 

5.15 

5.25 

5.25 

5.23 

Total 

4.80 

4.83 

4.96 

4.86 


*Level of agreement: 1 - strongly disagree, 2 - disagree, 3 - somewhat disagree, 4 - somewhat agree, 5 - agree, 6 - strongly agree 
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4. Conclusions 

This paper described a DB-CALL system using a task-oriented dialog processing 
technology. The task-oriented dialog understanding and managing knowledge 
are automatically trained from the intention-annotated real-dialog scripts for 
accomplishing the task. In the experiments, the system showed a good performance 
with the average task success rate of 85.52% and the average turn success rate of 
85.32%. Also, from the result of a satisfactory survey, we expected that our task- 
oriented dialog system might satisfy the needs of the second-language learners 
with high proficiency levels who want to communicate with natives in real-life 
situations. 
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Abstract. This paper presents information on the factors affecting the development 
of multilingual and multicultural communicative competence in interactive 
multimodal learning environments in an academic context. The interdisciplinary 
course in multilingual interaction offered at the University of Jyvaskyla aims 
to enhance students’ competence in multilingual and multicultural academic 
communication by promoting the use of their entire linguistic repertoire in various 
learning situations. Throughout the course, we observed the students’ engagement 
in multilingual and multicultural activities. These observations suggest that 
simultaneous use of multiple languages in synchronous and asynchronous learning 
environments has evident impact on the development of learners’ multilingual 
and multicultural competences as well as increases their multicultural awareness. 
Learners’ experiences, collected through learning journals and reflective feedback, 
suggest that the use of multimodal interactive learning environments may support 
multilingual and multicultural learning and enhance learner agency. 

Keywords: multilingual communication, multicultural communication, multilingual 
and multicultural academic communication competence, multicultural awareness, 
learner agency. 


1. Introduction 

This empirical study presents information about affordances for the development of 
learners’ multilingual and multicultural communicative competence in interactive 
multimodal learning environments. The context of the study is an interdisciplinary 
course in multilingual interaction aimed at enhancing students’ competence in 
multilingual and multicultural academic communication by promoting the use 
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of their entire linguistic repertoire in various social learning situations. A major 
source of inspiration is the MAGICC project of the EU Lifelong Learning 
Programme 2012-2014 (http://www.magicc.eu), which emphasises the role of 
languages and communication as part of academic expertise. Of similar importance 
is Blommaert’s (2010) perception of multilingualism as a complex of semiotic 
resources and a repertoire of varying language abilities. The focus is on various 
aspects of multilingual and multicultural communication. Due to the multilingual 
character of the course, students are required to have partial competence in at 
least two languages other than their LI. Furthermore, the presence of four to five 
teachers with various linguistic repertoires facilitates the creation of multilingual 
social space. To enhance learner agency and increase learners’ multilingual 
agility, task-based learning is employed. Multiple languages in synchronous and 
asynchronous learning environments are used simultaneously, an approach which 
results in multidirectional teacher-learner interaction and the enhancement of 
multicultural skills. 


2. Method 

Even though the concepts of multilingualism and multilingual competence have 
been explored from various perspectives, our focus is on learning. Our theoretical 
background, therefore, is to be found in Blommaert’s (2010) definition on 
multilingualism (see above) and in theories related to translanguaging (Garcia, 2009; 
Park, 2013; Swain & Watanabe, 2012). The purpose is to promote the development 
of learners’ multilingual communicative competence through multilingual mediation 
and meaning-making. Learners’ multilingual repertoires are activated through various 
interactive scenarios. In these they are expected to employ their problem-based 
learning strategies to find a solution or to act in a situation that is close to real life. The 
lessons are in line with scenario-based e-learning (Pappas, 2014), which gets learners 
involved in ‘real-life simulations’ and provides them with learning experiences 
aimed at gathering skills which may be useful for their future working life. Through 
the lessons, various aspects of multilingual and multicultural communication are 
addressed, including non-verbal communication, various mediation activities 
such as intercomprehension, activation of receptive skills between typologically 
related yet different languages (Berthele, 2007), and persuasion and negotiation in 
multicultural settings. In mediation activities, one or more languages are used for 
reading or listening and one or more other languages for speaking or writing. To 
entrance learners’ collaborative social skills, the educational mobile platform REAL, 
developed by the Jyvaskyla University of Applied Sciences, is used in scenario-based 
assignments, while the web-based learning platform Optima serves as the course 
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workspace. Optima further acts as a uniting factor facilitating the common learning 
experience. Learner logs have been used to obtain information on the usefulness of 
tasks, technology choices and the achievement of learning outcomes. In addition, 
a final survey on learner agency - on their commitment to and engagement in the 
learning process (Mercer, 2012) - was conducted. 


3. Discussion 

The course aim was to activate learners’ overall linguistic repertoires. Students 
found that the course helped to develop their linguistic agility and viewed it as 
a safe learning environment in which to share their ideas on various aspects of 
linguistic and cultural identity. 

“this class gave an important opportunity to reflect upon my recent and not- 
so-recent experiences in multilingual and multicultural environments... I 
had the chance to make sense and understand on a deeper level some of 
the things that I had encountered in the real world. Also, this class helped 
to break the barriers we tend to build between languages. It helped me 
understand that my language skills reach over the boundaries of languages, I 
understand and speak languages that I don’t officially understand or speak. 
That is an important discovery that everyone should get the chance to 
make already in high school, for example” (Student learner log, unedited). 

The feedback on the task design and use of the mobile platform received from 
students’ learner logs and course feedback forms was very significant, especially 
for the teachers. The mobile platform REAL was tested in scenarios related to 
the concept of culture and receptive multilingualism. The tasks consisted of 
communicative assignments, such as searching for information, negotiation and 
decision-making. Students were obviously not only aware of the raison d ’etre of 
scenarios, but they were also excited by the use of this particular platform due to 
its flexibility and the user-friendly mobile application. 

“This app [REAL] is innovative, functioning... it enables sharing the 
ideas... The chat is quick and dynamic, and what is best, it is accessible 
from more than one device. It is near to us, young people’s lifestyle, since 
we master the technology...” (Student learner log, unedited). 

Students felt that they were free to express their opinions via REAL and preserve their 
privacy at the same time. Voting and commenting was considered to be attractive and 
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to increase participants’ engagement in discussions. From the teachers’ viewpoint, 
the use of new technology offers not only a unique opportunity to document the flow 
of discussion, but also the possibility to pinpoint some ideas or recurrent themes in 
students’ discussions by means of word clouds and other visual tools. 

While student reflections and feedback collected through learner logs generally 
referred to the task design and the use of the mobile platform, the end-of-course 
survey provided information on students’ learner agency, that is, on their activity 
and initiative as well as their personal engagement in the learning process. 
According to Mercer (2012), agency reflects not only the learners’ attitudes and 
observable actions, but also their behavior, beliefs, thoughts and feelings, which 
may not be observable through the feedback and learner logs. The survey reveals 
that the majority of students took responsibility for shared learning situations and 
perceived the co-students as a resource for learning. The technological solutions 
used on the course were regarded as supportive for teamwork. Furthermore, they 
were perceived as providing a meaningful learning experience. 


4. Conclusions 

As the challenges of international and multicultural working life have increased, 
the need for multilingual and multicultural courses at the university level has 
grown. Courses in multilingual and multicultural communication may enhance 
learner agency and provide students with tools and strategies that will be useful in 
their professional careers. Furthermore, the integration of multiple languages into 
subject studies and the use of multimodal interactive online resources are essential 
because they present an integrated part of people’s professional frameworks. 

The experiences of learners and teachers collected on this course reveal a range 
of issues that would be important for further study: interactive multimodal 
learning environments, which seem to be a major affordance for both parties; 
the development of multidirectional networking skills and the acquisition of 
multilingual/multicultural communication competences. 
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Abstract. Education is a field that constantly changes, which dictates the need for 
continuing teacher professional learning and development. Teacher professional 
learning and development can be divided into two categories: formal learning/ 
development and informal leaming/development. This paper focuses on the 
experience of the presenters as coordinators of a large language section in a tertiary 
education institution, as this gave them the chance to develop professionally through 
informal learning, without attending any fonnal training sessions. Both coordinators 
did not have any previous experience in coordination, but they decided to keep a 
positive outlook on challenges and weaknesses, turning them into opportunities 
and strengths with the aid of technology. The experience of coordination will be 
presented using a Strengths, Weaknesses, Opportunities, and Threats/challenges 
(SWOT) framework of analysis. The present paper will report on this experience 
and how it helped the presenters develop professionally, and will also discuss the 
role of the use of online tools in the process. 

Keywords: continuing professional development, CPD, informal learning, SWOT, 
technology. 


1. Introduction 

The current project is an example of informal learning, reflecting on the experience 
of the authors as coordinators of a large language section in a tertiary educational 
institution in Cyprus. The authors assumed coordination duties in July 2014 and 
decided to take a reflection in-action and reflection-on-action approach in order 
to collaborate in the best possible way so that they could carry out their duties as 
coordinators. The application of the SWOT framework enabled them to formally 
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examine their experience and reflect on their own professional development 
through informal learning. 


2. Literature review 

Continuing Professional Development (CPD) has been defined in the literature as 
“a commitment by members to continually update their skills and knowledge in 
order to remain professionally competent and achieve their true potential” (CAE, 
n.d.). In education, CPD carries connotations of teacher quality, reflecting on the 
quality of learning received by students (Borg, 2015). UNESCO (2014) proclaims 
that “an education system is only as good as its teachers” (p. 9), stressing the need 
for CPD in order to improve teaching and learning. 

When CPD is cited in the literature, it is often linked to obvious examples of 
structured learning, such as seminars and conferences (see, for example, Villegas- 
Reimers, 2003). While these are excellent examples of CPD, there are also other, 
not so obvious activities which count as well, such as sharing and collaborating 
with colleagues, private study etc. CPD can be divided in two categories: formal 
and informal learning. For the purposes of the current paper, we will follow the 
definition provided by Levenberg and Caspi (2010, p. 324): 

Formal learning is learning supported by an educational or training 
institution, structured [... and] controlled by a teacher or a guide, resulting 
in a certificate. 

Informal learning is not supported by an educational or training 
institution. It is controlled primarily by the learner. 


3. Method 

The coordination project was conducted over a period of two years, starting 
in July 2014 and ending in August 2016. A SWOT framework was employed 
to identify and analyse the internal and external factors that can influence the 
viability of the project, following Rouse (2013). The SWOT analysis focuses on 
the following four elements: Strengths (S), Weaknesses (W), Opportunities (O) 
and Threats/challenges (T). Rouse (2013, para. 3) defines them as follows: 
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• Strengths: the internal attributes and resources that support a successful 
outcome. 

• Weaknesses: the internal attributes resources that work against a successful 
outcome. 

• Opportunities: the external factors the project can capitalize on or use to 
its advantage. 

• Threats/Challenges: the external factors that could jeopardize the project. 

The English section is the largest language teaching unit at the Language Centre of 
the University of Cyprus. Over 2000 undergraduate students from 22 departments 
register to around 100 courses every year. Approximately 20 instructors (both full¬ 
time and part-time) teach the various English courses that are currently on offer (13 
different courses, English for academic purposes and English specific purposes). 

The coordinators of the English section work closely with the various university 
services in terms of scheduling and allocating courses, overseeing courses 
and course supervisors, establishing communication within and outside the 
section, examining and granting course equivalences/exemptions and generally 
dealing with any issues relating to the English section. The current authors had 
no previous experience in coordination, but nevertheless made a choice to see 
this as an opportunity to develop professionally by keeping a positive outlook 
on threats/challenges and weaknesses and turning them into opportunities and 
strengths during this coordination project. 


4. Results 

4.1. Strengths 

The authors identified the following strengths on which they could rely throughout 
the duration of their coordination: (a) they both had previous experience as course 
supervisors which helped them understand the structure of the section in depth as 
well as the characteristics each role had i.e. the role of the supervisors and the role 
of the coordinators; (b) they both had long teaching experience at the University 
of Cyprus which translates into in-depth knowledge of not only the structure of 
the English section and the courses it offers but also the structure of the Language 
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Centre and the University of Cyprus; (c) they collaborated well with each other on 
various projects; (d) they have good organisational skills; (e) they are both adept in 
using technology; (f) they are both highly motivated individuals who always strive 
for the best possible outcome in whatever endeavour they follow, and finally (g) 
they are very keen on reflective practice as a means of developing professionally. 

4.2. Weaknesses 

In undertaking coordination, the researchers identified the project’s weaknesses so 
that they could approach them in the most effective way. First of all, a mentoring 
scheme was not in place, which means that the new coordinators needed to 
familiarize themselves with the task at hand on the job. Secondly, they had to deal 
with heavy teaching workloads. Moreover, there is a lot of paperwork involved in 
the coordination of a section of this size. Finally, there was lack of online databases. 
To deal with all these issues the use of technology was adopted, which helped make 
tasks less time-consuming, assisted online collaboration, supported the creation 
of online databases, and helped support each other throughout the duration of the 
coordination. 

4.3. Opportunities 

As aforementioned, the authors undertook the project with a positive outlook and the 
determination to turn weaknesses into strengths and challenges into opportunities. For 
example, they saw an opportunity to create an online database for the accreditation 
of external exams which would make the process easier for those involved (students, 
coordinators, administrative staff). They also took the initiative to create databases 
for syllabi, to develop handbooks for the English language instructors, to revise the 
descriptions of the English language courses in collaboration with colleagues. They 
collaborated with all the departments of the university closely to improve the existing 
schedule. Furthermore, they suggested the establishment of a mentoring scheme for 
new coordinators. They increased sharing and collaboration with colleagues through 
the use of technology. Finally, they increased the visibility of the English section with 
their active participation in events and conferences, as well as with their involvement 
in the organisation of events and conferences. 

4.4. Threats/challenges 

The challenges faced during the coordination project included budget constraints 
and tight deadlines. These external factors are commonly found in Higher Education 
institutions (see, for example, Yuan & Powell, 2013 on budget constraints). 
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4.5. The role of technology in the SWOT 

The application of technology during the coordination project made it feasible 
for the coordinators to collaborate efficiently, enabled them to reflect upon their 
work, kept them motivated, and helped them be organised. The tools used were the 
following: Dropbox, with which the authors collaborated in creating and editing 
the materials relating to the coordination of the section; Viber, Skype and emails 
for their communication; Microsoft Office (especially Excel and Word) for data 
analysis, development of materials, and creation of databases; and an online shared 
calendar to organise and manage tasks. 


5. Conclusions and reflections 

The authors, upon reflection through the application of the SWOT framework, 
came to realize that in dealing with weaknesses and threats/challenges, they should 
be well-informed in order to both pursue what was best for the English section but 
also to be able to work together on the various issues at hand. Especially in relation 
to weaknesses, it became evident that hard work was needed in order to be able to 
execute their duties well, it was also apparent that they needed to make suggestions 
to improve the situation in the future, for example they made a suggestion for a 
mentoring scheme for future coordinators. When it comes to threats/challenges, 
the authors realized that they needed to be informed on the policies and regulations 
pertaining to the budget issues and deadlines. 

Following a reflection-in-action and reflection-on-action approach during the 
coordination project, the authors were successful in developing themselves 
professionally through informal learning. Following this approach, they took 
numerous initiatives to improve practice and to create a more efficient working 
environment for themselves and their section during their coordination. The role of 
technology in this was paramount, as it supported them in creating an online space 
where they could work collaboratively to coordinate the English section. 
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Quizlet: what the students 
think - a qualitative data analysis 

Bruce Lander 1 


Abstract. The immediate area of interest in this study is the primary building 
block of all foreign languages: vocabulary acquisition. Due to recent updates and 
innovations in educational software, foreign language educators now have a huge 
supply of ever improving tools to help enhance, transform and completely modify 
learning. Despite this surge in interest of recent times, there is very little physical 
evidence that indicates an overall sign of approval from learners. This empirical 
study used the now well-known digital flashcard tool Quizlet to help a large group 
of lower intermediate students to improve their vocabulary and ultimately raise 
their English comprehension levels at a medium sized private university in Japan. 
They were encouraged to use the said tool throughout the duration of the year-long 
course and were asked for their feedback about it in the final class. This study 
helps to reinvigorate the notion that technology can and does help the modern 
day language learner and can be approved in a positive manner by the majority 
stakeholder; the student. 

Keywords: Quizlet, digital flashcards, blended learning, qualitative data analysis. 


1. introduction 

This paper will provide empirical evidence of what students think about using 
Quizlet. This tool was first released in 2007 and provided a contemporary alternative 
to traditional, paper flashcards. Quizlet has since undergone considerable changes 
and now provides near perfect text-to-speech pronunciation of words entered, has 
an in-built dictionary, and allows users to add visual aids in the form of all jpeg 
or gif files publicly available on flickr (flickr.com). These functions provide users 
with a tool far superior to their analogue paper flashcard counterparts. There are 
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now several competitors. However, the widespread use of Quizlet with its clever, 
interactive interface remains in language learning. 

Many emerging educational software programmes are now providing links to 
Quizlet and its user-friendly interface thanks to its increasing popularity the past 
two years in Japan and abroad. Ashcroft and Imrie (2014) gave a practical account 
of Quizlet and its full functionality at that time. They focused their account of 
Quizlet on the Puentedura’s (2013) Substitution Augmentation Modification 
Redefinition (SAMR) model. Although their account provided a highly practical 
outlook on the various functions available, it did not provide any factual data to 
disclose its approval with students. Barr (2016) classified users of Quizlet into 
three types, non-users who only use in class, visual and kinesthetic users. However, 
no evidence was given on student opinion on the tool. 

This begs the following questions: (1) what do students think of Quizlet and 
its digital flashcard format?; (2) do they prefer it to more traditional methods 
of learning vocabulary?; and perhaps more importantly, (3) is it effective? This 
study will introduce two sets of qualitative data obtained over a two-year time 
span in a test-based English language class and aims to answer these three 
questions. 


2. Method 

Quizlet was introduced to two sets of lower intermediate students in an 
introductory Test Of English for International Communication (TOEIC) course 
at a university in Japan. The first set comprised of 450 students varying in age 
and gender from ages 19-21 years old. This group was instructed from April 
2013 to January 2014 over the course of two 15-week semesters. The second set 
comprised of a smaller group of 380 students from April 2014 to January 2015, 
bringing the total sample size of this study to 830 subjects. No student within 
this group had any prior experience with Quizlet or any other digital flashcard 
tool to date. 

Although Quizlet was not the entire focus of this course, it played a large part in 
the internal and external running of the class. Each student within both groups 
was required to create their own word list in class and to review words out of 
class. All classes were conducted in computer classrooms with one computer per 
student. Students were encouraged and expected to review words autonomously at 
home either by computer or through the freely available smartphone application. 
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All lists were accessible by members of each class, creating a profoundly 
collaborative nature of learning. 

In the final class of the second term, students were required to answer two simple 
questions. The first question involved students giving their opinion in a 6-point 
Likert scale format, (1 ^strongly disagree, 2=disagree, 3=somewhat disagree, 
4=somewhat agree, 5=agree, 6=strongly agree) on the following construct: “I think 
smartphone apps can be effective for learning English” (Construct 1). 

Students were also asked to give their opinion on Quizlet through the following 
question: “Do you think Quizlet is a useful learning tool? If so why?” (Question 1). 

Both the construct and the question 2 were conducted online using surveymonkey. 
Questions were written in Japanese and English. Data was analysed with a text¬ 
mining tool called ‘ Wordminer ’, version 1.5 by Fujitsu. 


3. Discussion and results 


Table 1. Qualitative data obtained 



Phase 1 

Phase 2 


(n=432) 

(n=371) 

Total Japanese characters 

8,990 

11,325 

Average length of answer 

20.8 

30.5 

Retrieved 

676 

1,029 

Repeated 

50 

86 

No. of clusters 

7 

9 


Table 1 shows the volume of data obtained from both data collection phases. 
Altogether, 803 students responded. Of this total there were 788 respondents who 
answered in Japanese, while 15 answered in English. All English answers were 
translated into Japanese. This gave an average length of almost 21 characters per 
answer in Phase 1 and about 30 for Phase 2. Designed specifically for Japanese, 
Wordminer analyses repeatedly used phrases or text within a qualitative dataset. All 
redundant phrases are omitted by this tool, giving researchers the choice to choose 
between the number of repetitions in each dataset. This number was set at five or 
more for this study. Construct 1 and Question 1 above were compared and collated. 

2. The author carried out a similar study to this one in 2014 (Lander, 2015). However, that study analysed a different, and 
smaller set of data. 


256 













Quizlet: what the students think - a qualitative data analysis 


Figure 1. Distribution graphs for phase 1 (Lander, 2015) 3 
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Figure 1 shows all 50 of the phrases that were repeated five times or more on the 
left and then in a more comprehendible manner on the right. Figure 2 shows all of 
the 86 repeated phrases for Phase 2. The bold red numbers indicate the Likert-scale 
choice subjects chose for Construct 1. The cluster number demonstrates the typical 
pattern of text choice to describe Question 1. 

Figure 2. Distribution graphs for Phase 2 
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These distribution graphs indicate that the majority of subjects in this study gave 
positive comments. This point is demonstrated by the relative position of clusters 
in the central zone, which is true of both figures, but accentuated in Figure 2. Three 
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student answers to Question 1 are highlighted below. All comments were translated 
into English from their original for this paper. 

“I think Quizlet is a very useful learning tool. With Quizlet we can upload 
our own word list, review words and take tests as many times as we want. 
It also provides us with the correct pronunciation of words which is very 
helpful when having trouble reading” (Student 1). 

“I think it is useful, it provides many more ways to leam words than 
normal. Quizlet helps us to keep focused and not lose interest” (Student 2). 

“No, I don’t. I think using a regular dictionary for learning new words is 
more efficient” (Student 3). 

Students 1 and 2 give a clear indication that Quizlet provided a novel and enjoyable 
way to learn vocabulary. Critical comments although in the minority, were evident 
as is revealed by the comment made by student 3. By analysing qualitative, 
empirical data in this way, repeated words can be highlighted and easily identified. 
Table 2 shows a selection of words and phrases that were repeated five times or 
more. It is again possible to draw further conclusions through closer observation of 
the words obtained in this table. 


Table 2. Repeated words and phrases obtained 


Words, phrases 

No. of repetitions 

Our own pace 

12 

Correct spelling 

18 

Pronunciation 

13 

Countless times 

15 

Simple and easy to use 

11 

Various ways 

8 

Test function 

9 

Effective 

8 

Simple and convenient 

7 

Not really 

5 


4. Conclusions 


By using highlighted phrases and word items selected by a text-mining tool like 
Wordminer , it is much easier to see overall opinion of a blended learning tool 
such as Quizlet. Students in this study have shown a resounding approval of 
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digital flashcards, blit clearly some students prefer more traditional methods of 
learning vocabulary. Lander (2015) conducted a more detailed study to this one, 
and discovered that test scores in students who extensively used Quizlet can be 
boosted by 6% compared to those who did not. New additions to Quizlet and 
further improvements from competitors are inevitable. It is our duty as educational 
researchers to make use of such tools, to enhance and redefine the way our students 
learn vocabulary with technology such as this. 
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Abstract. Student and teacher activity in a closed Facebook group for a tertiary 
German class was observed during a 12-week teaching semester. This was 
complemented by questionnaires, semi-structured interviews with students, and 
teacher reflections in a researcher journal. Collected data were analysed using an 
inductive thematic analysis followed by a deductive Activity Theory (AT) analysis 
to explore the tensions between student and teacher expectations of the Facebook 
component of the course. The analysis showed individual variation in Facebook 
behaviours. A number of students were reluctant to write in the target language, 
German, reporting that they felt anxious when required to do so. It became evident 
that students differentiated sharply between their private Facebook interactions and 
their interactions in the Facebook group. Students adopted the Facebook group as 
an authentic language platform and continued to use the page after the course had 
ended. The Facebook group facilitated high quality meaning-focused target language 
production within the class group, and the participants were overwhelmingly 
positive towards their Facebook experience. 

Keywords: Facebook, German language learning, activity theory. 


1. Introduction 

The aim of this study is to understand the practices and perspectives of students 
and teachers using Facebook as part of the curriculum in a German language 
class at tertiary level in New Zealand. Facebook-based activities were introduced 
into the German intermediate class in an attempt to make German language 
study more authentic and more learner-centred for English-speaking learners. 
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This article will report the experiences of the 12-week period of Facebook 
integration. 


2. Facebook in language learning environments 

When Facebook first started to become mainstream in 2007, it seemed to be a 
platform soon to be replaced by the next wave of social media. Nonetheless, at the 
time of writing in 2016, Facebook remains the most used communication channel 
in the world amongst students and young people (Duggan, 2016). Facebook offers 
easy uploading mechanisms for photos and videos and its interface can be set to 
over 70 foreign languages, so it is a tool well suited for use in a foreign language 
classroom. Through Facebook, students can be immersed into the target language 
whilst simultaneously developing cultural knowledge and sharing German 
artefacts. Previous work using Facebook in the foreign language classroom 
includes Mills (2011), who used a Facebook group to make her French class more 
authentic. Blattner and Fiori (2009) saw great potential in Facebook groups as 
a platform for building telecollaborative communities in their Spanish language 
classes, since it was readily available and user friendly. Their learners were able to 
connect via Facebook with native speakers of Spanish. Blattner and Fiori (2011) 
used a Facebook site as part of their assessment in their intermediate Spanish class 
and found that through interaction with authentic Spanish speakers, the students 
gained a better socio-pragmatic understanding of the language. 


3. Methods 

3.1. Context 

A Facebook group was designed and all students of the language class joined the 
group (N=21). The instructor of the class started a closed Facebook group and sent 
out the link to the class and asked them to join the group. The students joined the 
group and were made administrators of the group. The teacher retreated into an 
observer role and left the students to construct the platform autonomously. The 
students were asked to make five posts about various German related topics. The 
posts had to include three complete sentences written in German. The focus was on 
meaning and only minor corrections on form were made by the teacher. The posts 
were not graded, rather they were marked on a pass/fail basis which represented 
just 2% of the overall mark. 
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3.2. Data collection 

The study used an ethnographic research method suitable for gaining rich data 
from this relatively uncharted platform (Beaulieu, 2004; Hine, 2005; Markham, 
2011). Data collected during the semester included pre- and post- questionnaires, 
interviews (n=10), a research journal which the first author filled in every day 
as a participant observer and the archive of the Facebook site containing all the 
contributions of the students and teachers. 

3.3. Data analysis 

The data were transcribed and coded using four cycles of inductive thematic 
analysis (cycles 1 and 3) and deductive coding using AT as a lens (cycles 2 and 
4). The data were first coded manually and then NVivo was used for further focus 
of the data. In the initial stage, the first cycle of coding was of an exploratory 
nature. The data was fragmented and codes were identified (Corbin & Strauss, 
2008). After the initial inductive cycle, a deductive cycle of analysis was applied 
to the data, with AT elements using Engestrom’s (1987) model of subject, object, 
community, rules, division of labour, tool/artefacts, and outcome (Figure 1). The 
data was entered into NVivo as predetermined nodes (Ezzy, 2002). The third cycle 
of coding was conducted inductively to step back from the pre-defined AT elements 
and to keep an open mind about the data. The final cycle of coding returned to AT 
components to identify patterns and emerging categories within the AT elements. 

Figure 1. Activity system 3 , based on Engestrom’s (1987) activity model 
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3. © Matt Bury, 2012 - CC BY-SA 3.0, https://commons.wikimedia.Org/w/index.php7curicN 18600235 
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4. Results and discussion 

The use of a Facebook group in a German classroom was well received but the 
students did not actively contribute to the group more than minimally. The data 
showed that the students enjoyed reading other students’ comments to improve 
their vocabulary but otherwise preferred to simply observe the activity in the group. 
Students reported enjoying the platform, and they found it easy to use and familiar, 
but they also felt anxious about producing posts. Students were conscious of fellow 
students being able to read their posts and judge their spelling and grammar. Most 
students were keen users and contributors in the beginning and also towards the 
end of the semester when the assignment task had to be completed. They did not 
spontaneously post in the group. 

AT analysis revealed three contradictions within the class activity system. The first 
contradiction was between the subjects and rides and between the subjects and the 
object: the students resisted the rules for using Facebook as a learning tool. They 
needed to be reminded to post their required posts. They did not use the Facebook 
group for spontaneous communication commenting, for example, “Facebook 
group was not a familiar educational environment for me” and “Facebook intruded 
into my personal Facebook use”. 

The second contradiction occurred between subject and tools. Students commented 
that “Facebook for learning was too forced” and “I could not read all the comments, 
it was too time-consuming, I preferred looking at the photos”. In interviews, 
students report preferring to use Facebook for sharing pictures. 

The third contradiction was between subject and division of labour. The teacher 
was trying to keep a low profile to make the environment more natural, but the 
students expected more feedback; they commented, “I felt a bit left out that I did not 
receive feedback”. Still the Facebook group was perceived by the students as part 
of their educational environment; it did not develop into a social communication 
group. Students commented that “Facebook means leisure time for me, this was 
too much work”. 


5. Conclusions 

The findings of this study raise many issues relating to the use of Facebook in a 
language class. In this study, although popular with students, Facebook did not 
lead to the anticipated extensive informal use of German. Some changes may 
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improve the results. The teacher as the designer of the assignment and also the 
person who assigns course grades is in a position of power. It may be better to 
assign the role of a facilitator of the Facebook group to a student, or a student 
teacher if available, as this may lead to the posts being more spontaneous. Perhaps 
Facebook communication would be richer if the posts were not part of the final 
course grade. To ease anxiety about performance in the target language, it may be 
beneficial if students worked in groups to produce posts for the Facebook group 
page. With regards to the design, rules and instructions for how to use the group 
for the assignment need to be explicit and clearly stated. Future developments in 
social media will doubtless offer new opportunities for extensive free production 
in a target language. 
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Abstract. The online education industry has had a rapid economic development 
in China since 2013, but this area received little attention in research. This study 
investigates Chinese undergraduate students’ online English learning experiences 
and online teacher-learner interaction in synchronous web conferencing classes. 
This article reports the findings from a pilot questionnaire survey in December 
2015. It is found that synchronous online English classes are often oversized (more 
than 50 students). However, students report a high level of online teacher-learner 
interaction. Further investigation is necessary to reveal what actual online learning 
and teaching activities are going on in synchronous web conferencing English 
classrooms in China. 

Keywords: synchronous web conferencing, SCMC, English language teaching, 
online interactions, China. 


1. Introduction and literature review 

Computer Assisted Language Learning (CALL) has become increasingly popular 
in China since 2013. According to the 2014 China Online Language Education 
Industry Report (iResearch, 2015), the market value of online language education 
in China is around 3 billion USD and the amount of online language learners 
reached 14.8 million in 2014 (iResearch, 2015). However, little is known about 
the recent developments and current problems of the Chinese CALL community. 
Behind the massive economic development, what are the real online teaching and 
learning activities going on? This study aims to investigate Chinese undergraduate 
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students’ online English language learning experience and online teacher-learner 
interactions in synchronous web conferencing English classes in the private sector 
in China using a questionnaire survey, interviews and a content analysis of the 
video recordings of synchronous web conferencing English classes. 

To explore the online learning and teaching activities in synchronous web 
conferencing English classes, the author focuses on online teacher-learner 
interaction. Moore (1989) defines learner-teacher interaction as the “dialogue 
between learners and the subject expert, which is regarded [essentially by] many 
educators and highly desired by distance learners” (p. 2). Synchronous web 
conferencing technology can afford synchronous interaction between online 
teachers and learners. Consequently, it is possible to look into how English is taught 
and learned online through studying the teacher-learner interactions in synchronous 
web conferencing English classes. Therefore, the research questions are: 

• What are Chinese undergraduate students’ online language learning 
experiences through synchronous web conferencing classes? 

• To what extent and about what content do online English language teachers 
and learners interact with each other in synchronous web conferencing 
classes? 

The first question aims to explore some basic information about students’ 
synchronous online learning experiences including the reasons for learning 
languages online, the types of technology used for language learning, the length, 
size and content of online language classes, etc. The second question mainly 
focuses on online teacher-learner interaction, the amount and the content of online 
interactions in synchronous web conferencing English classes. 


2. Research methods 

The questions in the survey are developed based on the relevant literature (e.g. 
iResearch, 2014; Li et al., 2014; Murphy, 2015; Tan, 2013; Zhang & Rong, 2013). 
The questionnaire is designed in English and translated into Chinese to avoid 
misunderstandings and attract more replies. The questionnaire was distributed 
through popular social networks in China (e.g. WeChat andQQ). The data collection 
follows a chain referral sampling method (Biernacki & Waldorf, 1981) because 
one student who had taken synchronous web conferencing English classes can 
answer the questionnaire and share its link to more people with such experiences. 
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In total, there are 221 replies on general online language learning experiences and 
42 replies on synchronous web conferencing language learning experience. This 
paper reports key findings on synchronous web conferencing English language 
learning experience because synchronous web conferencing classes can support 
online interaction, which is key to language learning (Ellis, 1991). 


3. Findings 

At the beginning of the survey, students are asked about their online English 
language learning experience through different types of technology. There are 
42 participants (42 out of 221, p=19%) who have taken synchronous English 
language classes through web conferencing classrooms. The following reports on 
participants’ online English language learning experiences and on online teacher- 
learner interaction through synchronous web conferencing English classes. The 
findings presented below are all results from multiple choice questions. 

3.1. Online learners’experiences 

Regarding content of synchronous web conferencing English classes, 57% of 
participants have taken English test preparation classes (e.g. IELTS/TOEFL). 
Almost half (48%) of the respondents have taken English language proficiency 
courses to improve their speaking and listening skills, and one third of participants 
have learned grammar, vocabulary, reading and writing skills in synchronous 
online classes. 

In terms of how many hours of online classes participants have taken, while some 
(29%) have taken more than 30 hours of synchronous web conferencing English 
classes, almost half of them have taken less than ten hours of online classes. 

As for the size of synchronous web conferencing English classrooms, 60% of 
respondents report to have more than 50 in the online classes. However, there are 
also some smaller classes with less than ten students (p=22%) or even only one 
student (p=12%). 

Most participants (88%) choose to take synchronous web conferencing English 
classes instead of learning in face-to-face classrooms because they do not have to 
travel, which is very convenient and efficient. There are also many respondents 
who choose online classes because of their lower prices. A few (24%) participants 
believe they study English more effectively in synchronous web conferencing 
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classes while those (24%) who take one-to-one online classes through synchronous 
web conferencing tools highlight the personalized learning opportunities. 

3.2. Online teacher-learner interactions 

This section reports findings on questions regarding online teacher-learner 
interaction through synchronous web conferencing English classes. 

Participants take online English courses from different online teaching platforms 
with different technological affordances. In this survey, it is found that 79% of 
participants can post text chat messages in the synchronous web conferencing 
classroom so that they can have synchronous and ongoing conversations with their 
online teachers. Moreover, almost half (45%) of respondents are allowed to use 
audio channels to practice speaking skills with their online teachers and 19% can 
even use video cameras in their synchronous English classes. 

When an online teacher presents content knowledge, very often (83%) there are 
students who raise questions about the course content, and sometimes (57%) 
some students report technical issues. Furthermore, sometimes (45%) there are 
interactions among students themselves about the course content being presented 
by the teacher. 

When an online teacher asks questions, very often (79%) students answer the 
questions through text chat messages. However, some students complain that 
occasionally (21%) the teacher moves on before they finish typing their answers. 
And a few students (17%) report having little or no ‘Questions and Answers’ 
interaction between online teachers and learners in their synchronous web 
conferencing English classes. 


4. Discussions and conclusions 

4.1. What are Chinese undergraduate students’ 

online language learning experiences through 
synchronous web conferencing classes? 

Generally speaking, students’ online English language learning experience vary 
among individuals, but there are some general trends. First, in terms of the course 
content, synchronous web conferencing English courses on exam preparation and 
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communicative skills (e.g. speaking and listening skills) are most popular among 
students. Second, the size of synchronous web conferencing English classes is 
usually large (more than 50 students). Third, convenience and good price are two 
main reasons for students to choose synchronous online classes over face-to-face 
classes. 

4.2. To what extent and about what content do online English 
language teachers and learners interact with each 
other in synchronous web conferencing classes? 

In terms of technological availability/affordances, most respondents are able 
to participate in synchronous interaction with their online English teachers in 
synchronous web conferencing classrooms; some can even use audio and video 
channels for more multimodal teacher-student interaction. Participants also report 
a relatively high level of online learner-teacher interaction in both cases when an 
online teacher presents content knowledge and also when the teacher asks students 
questions. 

However, some findings from the questionnaire are still not clear and can even be 
potentially contradictory. For example, most students (60%) report having an online 
class of more than 50 students. Meanwhile, they report to have a good amount 
of online teacher-learner interactions. So, the question is how can online English 
teachers take care of so many students in one synchronous web conferencing 
classroom and yet still be able to have sufficient teacher-learner interactions. 
Clearly, more investigation is needed to further reveal what online teaching and 
learning activities are actually going on in synchronous web conferencing English 
classes in China. The author intends to interview online English teachers and 
learners, and conduct a content analysis of video recordings of synchronous web 
conferencing English classes to find more answers to this question. 
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and an online writing task 
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Abstract. Seeking to identify and activate the Receptive Vocabulary (RV) of English 
Language Learners (ELLs), we designed (1) an online five category multiple-choice 
vocabulary survey that more quickly measures vocabulary knowledge, and (2) 
an online creative writing task where ELLs chose RV items identified in step (1). 
While RV items of highly proficient ELLs cause difficulties in language production, 
writing tasks promote active vocabulary use and knowledge (Laufer, 2013). We 
designed a four stage, five week writing task based on task-induced involvement 
constructs where vocabulary acquisition involves need, search and evaluation 
(Laufer & Hulstijn, 2001). Results show (1) 74% of RV items were activated, (2) 
ELLs' Productive Vocabulary (PV) increased from 21% to 37%, and (3) unknown 
vocabulary items decreased from 25% to 14%. In future work we will measure the 
individual and presumably diverse use of RV. 

Keywords: vocabulary measurement, receptive vocabulary, corpus-based 
vocabulary, online creative writing. 


1. Introduction 

The large number of vocabulary items that are in the RV but not in the PV of highly 
proficient ELLs causes difficulties in language production (Laufer, 2013). While 
existing tools mostly measure the properties of RV and PV, and RV-PV ratios, only 
few studies focus on the learning process of PV (e.g. Pignot-Shahov, 2012). 
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Writing activities have been said to promote the development of vocabulary 
knowledge (Laufer, 2013). Unknown vocabulary items that are unfamiliar to ELLs 
might require more training before they become RV. RV items, on the other hand, 
are prime candidates for activation because the items’ phonology, morphology, and 
syntax are already known to the ELL. As such. RV items need to be identified 
because they should be activated through explicit instruction to become PV(Lee 
& Muncie, 2006). 

To observe how RV changes to PV among groups of ELLs, we ran a two phase 
study. In Phase 1, to identify the ELLs’ RV, we designed and administered a five 
category multiple-choice online vocabulary survey. In Phase 2, we ran a four stage 
online creative writing task to improve the ELLs’ PV knowledge. ELLs used at 
least 20 out of 148 RV items that we grouped into ten thematic categories. ELLs 
received corrective feedback on their RV activation. 


2. Method 

2.1. Phase 1: five category multiple-choice 
online vocabulary survey 


Existing tools for measuring vocabulary knowledge include the following: (1) 
the productive vocabulary level test (Laufer & Nation, 1999), which measures 
lexical knowledge, but does not necessarily measure vocabulary production (Lee 
& Muncie, 2006); (2) the English as a foreign language vocabulary test (Meara, 
1997), which is fast but lacks reliability (Schmitt, 2014); and (3) the vocabulary 
knowledge scale (Paribakht & Wesche, 1997), which asks examinees to write 
sentences, thus improving the reliability of PV measurements but requires more 
testing and grading time per vocabulary item. 

To avoid impeding upon our other learning activities, we needed to measure 
the levels of vocabulary knowledge of 300 vocabulary items within 15 minutes. 
Since no existing technique measures at this rate, we developed a radio-button 
style online survey that ELLs respond to in less than three seconds per vocabulary 
item. 

For each vocabulary item, ELLs chose from five statements: (1) I never saw this 
word before, (2) I forgot what this word means, (3) 1 can guess what this word 
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means, (4) / know what this word means, and (5) I use this word when I write 
or talk. The choices were based on self-introspection. Items with mean scores 
between three to four were considered RV items. This survey was conducted two 
times with a 13-week interval. 

The vocabulary items were selected from the college entrance examination stratum 
of the Hokkaido University English Vocabulary List (Sonoda, 1996). This list 
stratifies vocabulary items into five levels, from middle school to advanced college. 
The entrance examination level consists of 2,096 items. Based on our vocabulary 
survey, we chose thematically-grouped 148 RV items that were likely to belong to 
the RV of the majority of our 134 ELLs. 

2.2. Phase 2: four stage online creative writing task 

Laufer and Hulstijn (2001) proposed a task-induced involvement construct, where 
the more cognitively involved ELLs are, the deeper vocabulary knowledge can be 
acquired. Kim (2011) and Lee and Muncie (2006) both reported positive effect on 
the development of vocabulary through the adaptation of task-induced involvement 
in writing activities. 

Our ELLs engaged in a four stage online creative writing task over a five week 
period: 


• Stage 1 (preparatory): ELLs wrote an approximately 150-word story on an 
online forum that was viewable by all 134 ELLs, and read the story aloud 
to classmates. 

• Stage 2 (design): ELLs designed a story by using a template to specify 
characters, settings, events, and ending. 

• Stage 3 (write and activate RV): the 148 target RV items were presented 
in 10 categories to facilitate ELLs writing task. ELLs wrote a 400 to 600- 
word story that included at least 20 out of 148 RV items. 

• Stage 4 (rewrite): ELLs received corrective feedback, improved writing, 
and read story aloud to classmates. 

The 148 RV items were presented in ten thematic categories to facilitate the ELLs’ 
writing tasks, which are emotion, action, personality, settings, solutions, problems, 
objects, events, situations, and jobs. 
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3. Discussion and conclusion 

Figure 1 shows that between the pre- and post-surveys PV items increased from 
21% to 37%, unknown-vocabulary items decreased from 25% to 14%, and RV 
items stayed mostly constant at 52 % and 49%. Our results are consistent with 
Laufer and Goldstein (2004), which states that RV is about 50% of total vocabulary. 
This suggests that the 700 items that were used in our survey seem to have been 
appropriately familiar to our ELLs. Moreover, the fact that RV items remain the 
same also implies that the process of vocabulary knowledge is a developmental 
continuum (Schmitt, 2014), RV activation is unlikely through one-time practice. 

Figure 1. Percentages of the number of mean response values within four ranges 
for each of the 700 vocabulary items in the five category multiple- 
choice online vocabulary survey (the five categories are: (1) 1 never 
saw this word before, (2)1 forgot what this word means, (3) I can guess 
what this word means, (4) I know what this word means, (5) I use this 
word when I write or talk) 



Figure 2. Percentages of the number of 148 RV items having mean response 
values in the three to four range or four to five range after the online 
creative writing task 



■ 4-5 Range 

■ 3-4 Range 


n=148 
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Figure 2 shows that for 74% of RV items the mean response values increased from 
the three to four range to the four to five range after the online creative writing 
task. This suggests an increase in vocabulary knowledge. We also observed that the 
items with large increases occurred frequently in ELLs’ writing corpus. 

Based on infonnal interviews conducted after the fourth stage of the writing task, 
ELLs stated that the writing task was time-consuming, and that writing using the 
required RV items was a challenge. 

For the sake of teaching a group of students uniformly, we assumed that ELLs 
shared the same 148 RV items. Although results do show that these RV items were 
activated to PV for our group of students, in future research we might measure 
individual gains using tools such as Lexinote (Tanaka, Yonesaka, Ueno, & Ohnishi, 
2013) that tracks vocabulary acquisition of individuals over time. 

With the developmental nature of vocabulary acquisition (Schmitt, 2014), 
observing PV gains over multiple learning sessions is desirable. We relied on ELL 
self-introspection to determine vocabulary knowledge. While this technique may 
be suited for assessing passive memory recall of RV, a more reliable measurement 
is desired for active memory recall of PV. 

ELLs’ PV remain small compared to their RV. Though our method may assist 
instructors in identifying RV items and activating them through writing tasks, the 
gains of ELLs’ PV knowledge remain unclear. A more direct approach to promote 
ELLs’ PV knowledge may be required for future research. 
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Abstract. In this paper, we present two versions of a learning game developed 
respectively at the Grenoble Alpes and Bologna University. This research focuses 
on a digital game aimed at favouring the learners ’playful attitude and harnessing 
it towards accuracy aspects of language learning (lexicon and morphology, here). 
The game, presently available for English, French and Italian, could be described 
as a letter game stemming from the archetypal example of Turoff’s Boggle. Avatars 
of this game genre both exist as commercial off the shelf games and as learning 
games. We explain in this paper how our two versions respectively tackle two 
different aspects of language learning. We conducted an experiment in which all 
students tried both versions to study their perceptions of both games contrastively 
in order to prepare for the development of subsequent versions of the game. 

Keywords: game based learning, Italian as a foreign language, learner perceptions, 
lexicon, morphology. 
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1. Game based (accuracy) learning 9 

Many researchers see various advantages in game based learning (e.g. Oblinger, 
2004). Some see games as consistent with the central notion of tasks (Cornillie, 
Thorne, & Desmet, 2012). Yet the emergence of a playful attitude, considered 
productive in games in terms of (language) learning (Silva, 2008), is far from being 
systematic in learning games. In the hope of favouring its emergence, we resort to 
the metaludic rules (pertaining to a game genre) (Silva, 1999) of successful and 
repeatable games (digital or board games, which do not rely on a plot). 

Our research could be described as ‘design based’, which is inseparable from 
iterative development (Harvey & Loiselle, 2009). To prepare for subsequent 
iterations, we implemented two versions of the same game with a view to comparing 
the responses of learners to both. Each version has its own pedagogical approach 
but both address accuracy - micro-operations and language correction - as opposed 
to fluency (Portine, 2013). The first prototype was conceived and implemented at 
the Grenoble Alpes University (Loiseau, Zampa, & Rebourgeon, 2015), within the 
Innovalangues project (Masperi & Quintin, 2014), while the second was developed 
by the University of Bologna within the context of the ‘E-LOCAL for all’ project 
(Ceccherelli & Valva, 2016). 


2. The prototypes 

Despite adopting different points of view, both versions of our digital letter game, 
called Magic Word, are based on the same metaludic rules that could be exemplified 
by the well-known example of Boggle 10 , where the user is presented with a 4x4 
letter grid and can create inflected forms (‘example’ and ‘examples’ are considered 
two separate words) using contiguous letters, in every direction, using each letter 
cell at most once per word form. 

The Grenoble prototype was implemented in 2014 * 11 . Available in French, English 
and Italian, it aims at harnessing normative rules - rules adopted by advanced 
players of the game (Silva, 1999) - to work on morphological aspects of the 
language. It is inherent to the game, especially for languages with rich inflexion 
mechanisms, that the player should exhaustively seek all forms stemming from 


9. Our approach is consistent across projects, this re-uses parts of Loiseau, Hallal, Ballot, and Gazidedja (2016, this volume) 
rather than artificially paraphrasing it, but also completes it. 

10. Designed by Turoff in 1972, see https://en.wikipedia.org/wiki/Boggle. 

11. http://gamer.innovalangues.net/magicword/ / https://github.com/InnovaLangues/Magic-Word-game 
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found words (Loiseau et al., 2015). In Figure 1, for instance, if both players found 
‘ mia ’ (‘my’, fem. sing.), the player who realises that its masculine (‘ mio ’) and 
plural feminine (‘ mie ’) forms are also in the grid will have an advantage over the 
opponent. Even if a player finds a form by luck, the competitive nature of this 
version provides an incentive to infer the category of the word in order to see if the 
grid does not contain other forms. Games are played one-on-one (asynchronously) 
in three sets. While the lexical nature of the game is mainly addressed through the 
existence of a personal lexicon for each learner, called a ‘wordbox’, stemming 
mechanisms are at the core of the rules. 


Figure 1. Screen captures of both versions of the game (left: Grenoble / right: 
Bologna) 



The Bologna prototype 12 , solely in Italian, is to be interfaced with the ‘E-LOCAL 
for all’ project. Dedicated to helping student mobility and multilingualism, the 
project proposes eight core units built around a main theme linked to a possible 
real-life situation (Ceccherelli & Valva, 2016). This thematic progression calls for 
a focus on vocabulary that the Grenoble version coidd not provide. Creating grids 
containing certain forms is a complex algorithmic problem. This version provides 
a solution able to produce a grid containing a significant number of E-LOCAL 
terms (Roccetti et al., 2016). Each grid in this prototype has a specific cultural 
background concerning Italy and specifically Bologna; graphics were adapted 
through pictures linked to each theme to convey that cultural focus. 


3. Experiment protocol 

Following design based research principles, we took advantage of these two 
versions to gather learner reactions to each prototype’s specificities: different 


12. http://www.lilec-linguistica.it/magicword/page.html / https://github.com/giacomo-mambelli/magicword 
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learning objectives (morphology vs lexicon) sought after through different game 
structures (speed and competition vs completion of lexical puzzles), with different 
input modalities (sliding vs successive clicks) and layouts. 

The experiment was conducted for Italian as a foreign language over 20 groups of 
learners from the Universite Grenoble Alpes and the Universita di Bologna (group 
levels Al to Cl). It took place in March and April 2016 during the classes of eight 
different teachers. The project and games were introduced briefly. Around 40 minutes 
were then left to the 148 learners 13 surveyed to test both games and 20 minutes to 
fill out the questionnaires presented to them (in English, French or Italian). To make 
sure that results were not influenced by which game was presented first, some groups 
started with the Bologna version while others with Grenoble’s. A third of the students 
(59) were given a self-assessing pre-test. Students were to tick the words they knew 
from a list. It meant to get an indication of their lexical knowledge, but also to see 
whether reading some words present in the Bologna grids before playing would help 
them solve the puzzles. Such short exposure to the games will not allow us to draw 
any conclusions concerning their learning outcomes (Girard, Ecalle, & Magnan, 
2013); we focused on the students’ reactions and expectations. 


4. Results 

We are interested in the learners’ perceptions of the game and their inclination to 
play them again. After the experiment, we asked them whether they woidd like 
to play (any) Magic Word during their Italian language class, nearly 85% of the 
students answered positively. 

The students were also asked to answer on a four-level Likert scale various 
questions, including concerning their appreciation of the games (how much fun 
they had playing and whether they would like to play again) and if they felt they 
could learn while playing them. Considering the two upper levels of the Likert 
scale as positive outcomes, about 80% of the students found the Bologna version 
fun and more than 75% wanted to play it again, while more than 85% found the 
Grenoble version fun and 85% wanted to play it again. 

Attributing a number (one to four) to every level of the scale allowed to perform 
inferential statistics 14 . The following results always use such data with questions 


13. 75% female, 90+% between 18 & 24 years old. 

14. The tests performed were paired samples t-tests, Welch two samples t-tests, Pearson’s Chi-squared test with Yates’ continuity 
correction and Pearson’s product-moment correlation (Norman, 2010). 


280 





Exploring learners’ perceptions of the use of digital letter games... 


directly targeting each feature described. For instance, the differences above were 
significant (Fun: f(147)=-4.3533, p<. 001; Play again: f(147)=-3.5961, jrK.001), 
even though the students significantly preferred the graphics of the Bologna version 
(92.5% favorable opinion for Bologna vs 83% for Grenoble - t{ 1 47)=3.2286, 
/K.005). This difference could be linked to the fact that 93% viewed competition 
positively (Grenoble) against 79% appreciating being able to play without the 
pressure of a timer (Bologna). 

The learners found the Bologna version slightly, yet significantly, more relevant 
for learning than the Grenoble version (75% favorable opinion for Bologna vs 71% 
for Grenoble (t( \ 47)=2.5376, /;<.()5), thus echoing the teachers preference for the 
lexical dimension of the game. 

Finally, results to the pre-test did not yield effect on other variables, taking it did 
not influence the players’ achievements. Flowever, its mere presence underlined the 
importance of the Tudic context’; learners who were administered the tedious pre¬ 
test (checking long lists of words) showed less inclination towards playing either 
game again (Reusing MW in class: / 2 (1)=4.0281, /K.05; Play again - Grenoble: 
f(92.5)=2.9759, /K.005; Play again - Bologna: f(102)=1.7607,/X.05). 


5. Discussion, future works and conclusion 

Our experiment, testing two versions of Magic Word, shows positive reception of 
both versions in terms of game characteristics and expected learning outcomes. 
Though the fact that the games were played for less than an hour should be taken 
into consideration when interpreting the results, this reception is encouraging. 
Learners display a certain preference for the Grenoble version, though the Bologna 
version is perceived as more likely to result in learning. We also know its rules are 
more favoured by teachers, which could be linked to the level of rules at which 
the ‘learning’ component is integrated (constitutive or even metaludic for lexicon 
vs normative for morphology). Thus, future versions of the game should (1) adapt 
the Bologna rules to introduce a competition element, and (2) make the normative 
rules of the Grenoble version more perceivable by beginner players. 

Consequently, the algorithm conceived in Bologna is of the utmost importance 
for both institutions as it will facilitate the integration of the game in classes. 
Completing these results, a focus groups showed that teachers are more prone 
to using Magic Word for lexical acquisition. The algorithm thus opens doors for 
customisation of the content by teachers, one of their central needs (Hallal, 2015). 
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Thanks to the open-source nature of both prototypes, a new version is being 
implemented in Grenoble. Though this work is mostly focused on the ludic structures, 
the response of the students who took the pre-test also underlines the influence of the 
ludic context on the reception of the game, highlighting Silva’s (2008) point of view. 
Finally, it is worth mentioning that neither the proficiency level of the students, 
nor their gaming experience or gender yielded any significant difference in their 
appreciation of either game. 
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focusing on oral production (and comprehension) 
through asynchronous interaction 
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Abstract. In this paper, we present a learning game designed according to a strategy 
focusing on favouring the learners’ playful attitude. The game’s modalities pertain 
to what we might call ‘guessing games’. The chosen avatar of such guessing games 
both exists as learning and Commercial Off The Shelf (COTS) board games. We 
explain in this paper how we adapted them into a digital game, taking decisions 
prompted by language learning but also addressing technical and contextual issues. 
We resort to the literature on communicative strategies to justify the expected 
outcomes of using this game and describe certain feedback stemming from self 
enrolling user tests performed by language teachers in early 2016. We conclude by 
describing the next steps in this research. 

Keywords: game based learning, strategic competence, oral production, oral 
comprehension. 


1. Guessing game based learning 5 

Many researchers see various advantages in resorting to game based learning. 
In the field of language learning, some see in games an opportunity to overcome 
excessive self consciousness impeding involvement in tasks (Villez, 2006). Yet 
the emergence of a playful attitude considered productive in games in terms of 
(language) learning is far from being systematic in learning games (Lavigne, 
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2013). The metaphor of ‘chocolate coated broccoli’ for serious games has even 
been used in various publications (see Sobke, Broker, & Kornadt, 2013). To avoid 
this type of reaction, we have adapted Sobke et al.’s (2013) design suggestions. 
Though they advocate for directly using COTS, they acknowledge that COTS 
that can be enriched with educational content are rare (Sobke et al., 2013). 
Consequently, we have chosen to design games by resorting to metaludic rules 
(pertaining to a game genre) (Silva, 1999) of successful games. Additionally, we 
have so far designed games that offer the student the possibility to repeat games 
(in a casual game manner) rather than resorting to an elaborate one time play 
scenario. 

In this paper, we aim to introduce a game prototype designed and developed within 
the GAMER work package of the Innovalangues project. We focus on Game of 
Words 6 , which could be described as a guessing game. The metaludic rules are as 
follows: 


• one player/team holds a knowledge (often a word, sometimes an expression 
or a person); 

• one player/team ought to guess this knowledge; 

• specific modalities are defined as to how this knowledge is to be transmitted 
between the two entities. 


Depending on the said modalities, such communication games seem to be a way 
by which learners might be led to work on the appropriate use of the ‘strategic 
competence’. Each such set of modalities defines another avatar of guessing games. 


2. Strategic competence 

Canale and Swain (1980) define the strategic competence as “verbal and non¬ 
verbal communication strategies that may be called into action to compensate 
for breakdowns in communication due to performance variables or to insufficient 
competence” (p. 30). Many authors concur in dividing those strategies into two 
categories (sometimes bearing different names depending on the author): message 
adjustment strategies and resource expansion strategies (CECRL, 2000; Dornyei 
& ThurrelL, 1991; Mariani, 1994). 


6. http://gamer.innovalangues.net/gameofwords / and https://github.com/InnovaLangues/GameOfWord 
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While the Common European Framework of Reference for languages (CEFR or 
CECR in French) does not formally define the strategic competence, it stresses the 
importance of strategies (be they communicative or learning strategies) (CECRL, 
2000), thus highlighting the point made earlier by Dornyei and Thurrell (1991). 
Additionally, Mariani (1994) mentions that the acquisition of resource expansion 
strategies are by definition more profitable to the learner, as they do not rely on 
their avoiding difficulties. 

In this paper, we focus on verbal production strategies as they are at the core of 
our game’s ludic structures, and more precisely on resource expansion strategies. 


3. Our prototype 

The avatar of guessing games we chose for the first version of this prototype is 
based on the well-known modalities of taboo 7 ', in order to convey their knowledge 
(a word) the first team can neither use that word, nor a list of words deemed by 
the designer of the game as useful to describe the word. By essence, these rules 
force the learner to find ways to have other players find a specific word without 
ever mentioning it. Indeed one can link the task performed in the game to the one 
used by Paribakht (1985) in her experiment meant to establish a taxonomy, where 
she would ask the student to communicate a lexical item (concrete or abstract) to a 
(native) student, without using the word. 

The chosen rules are also consistent with some of Dornyei and Thurrell’s (1991) 
suggestions for strategic competence focused learning tasks. These rules are also 
consistent with games used in class by teachers of English, French and Italian as 
foreign languages, according to interviews we performed. 

One of the advantages of using a digital game is that it can be used both in 
and out of the classroom, but it also comes with constraints, especially when 
devising a first prototype. We implemented our prototype according to two such 
constraints: 

• the game was to focus on oral production and comprehension; 

• the game is asynchronous in its modalities. 


7. Designed by Hersch & Bougrele (1990), see https://en.wikipedia.org/wiki/Taboo_(game). 
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The oral component is a priority due to its relative under-representation in 
CALL, but we only handle audio, both to make the development faster and 
because video would require a lot more space on the server. But this discards 
one of the four approaches identified by Paribakht (1985) in her taxonomy, 
which is non-verbal (mime as opposed to linguistic, contextual, and conceptual 
approaches). 

The asynchronous aspect rather emerged from the game mechanics. Such guessing 
games induce that three persons are required to make the game playable, which 
can be an issue. Using synchronous modalities, the lack of players can result in 
players spending most of their playing time waiting for other users. On the other 
hand, in asynchronous modalities, we can ensure that the player can have some 
activity anytime they connect. But the downside of this decision is that it cuts 
interaction down to the minimum, and needs to be orchestrated. 

In a role playing game fashion, we associated each role to a trade: druid, oracle, 
and augur (cf. Figure 1). The oracle's role is to record a riddle meant to allow 
other players to find the explained word (‘Coffee’ in Figure 1) without using 
any word displayed on the ‘card’ provided (see ‘Input’ in Figure 1). The druid 
makes sure that the recording is technically audible and that the oracle did not 
use any forbidden word. Finally, if the recording is adequate, it is submitted to the 
augur whose goal is to interpret the oracle’s riddle. 

Figure 1. Roles, tasks and data lifecycle in Game of Words 
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Each role is associated to a scoring category in order to motivate players to play all 
roles, as the playability of the game directly relies on people adopting every role. 
Indeed, if no one verifies, as a druid , that oracles follow the rules, there will never be 
recordings for augurs, and the oracle’s activity will remain pointless. Yet to provide 
more game opportunities, a given recording can be served to various augurs. 

Players can also earn druid points by creating new cards (a word to guess associated 
with one or more forbidden words 8 ). Resorting to user generated content makes the 
game playable in any language that can be written using UTF-8 characters and 
verbalised (sign languages cannot be handled thus far, for instance). 


4. Experiments, future works and conclusion 

The first development cycle led to a testable game prototype. In order to prepare 
for the following iteration, a user test was set up with teachers and language 
students. The game was made available to the public and submitted to teachers and 
learners to use autonomously with no other guidance than a short explanation of 
the functionalities. Users could later fill a questionnaire. Qualitative analysis of our 
data allowed us to identify some bugs and to enrich the database with new ‘game 
cards’ created by teachers and learners. The test also raised some specific needs 
of teachers to improve the functionalities: mainly to allow to delete content. As a 
learning task, one teacher had his student create cards to play later. In this process, 
he wanted to be able to validate the cards. 

The resulting prototype is still in alpha stage, but playable, and we plan to carry out 
an experiment in the winter to both evaluate Game of Words from the standpoint 
of game structures - do the students adopt a playful attitude? What prevents them 
from acquiring it? - and of the strategies invoked. As such, we hope to collect 
enough recordings to compare the students’ productions with existing strategic 
competence taxonomies. 

These results will allow us to implement a first version of the game, which will 
in turn allow the evaluation of the learning outcomes of the game. More game 
modes might be included. Some modes might offer new knowledge transmission 
rules, based on other such activities (Dornyei & Thurrell, 1991) or exploring 
multimodality. Finally, other game modes might build on LI based strategies and 
the growing body of literature regarding intercomprehension. 


8. The number of forbidden words varies depending on the level of the player (as teachers we interviewed do in class). 
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Abstract. The Common European Framework of Reference (CEFR) proposes Task- 
Based Language Teaching (TBLT) as an important strategy to develop the learners’ 
linguistic competences along with their communicative skills. Since it is learner- 
centred and relies mostly on engaging learners in meaningful communicative 
interchanges in a foreign language, it allows for greater interaction and collaboration 
between them in the development of products, in problem-solving processes and in 
the construction of knowledge. Nevertheless, teachers have revealed some resistance 
to this approach. Pan-European Task Activities for Language Learning (PETALL) is 
a project involving ten countries and seeks to address these problems by constructing 
a transnational strategy for Information and Communications Technology (ICT)- 
based task design management. It aims to produce tasks that can be implemented in 
different educational contexts, and offer training courses to help teachers build their 
confidence in TBLT. This presentation seeks to offer an overview of the project, 
including its objectives, underlying principles and deliverables (samples of good 
practices, the website, the courses, and the international conference). 

Keywords: task-based language teaching, TBLT, ICT, CEFR, teacher training. 


1. Introduction 

PETALL is a project co-funded by the former EU Life-Long Learning Programme. 
The project seeks to address three specific objectives of the programme (European 
Union, 2006), namely the promotion of language learning and linguistic diversity, 
the support to the development of ICT-based resources and the improvement of 
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their quality by encouraging “the best use of results, innovative products and 
processes” along with the exchange of good practice “in order to improve the 
quality of education and training” (p. 49). 

The project consortium, constituted of twenty institutions from ten countries across 
Europe, is coordinated by the University of Algarve, Portugal. 

Its main purpose is to encourage teachers to make use of ICT-resources in task- 
based language teaching, an approach to which the CEFR (Council of Europe, 
2001) dedicates a whole chapter; ‘Tasks and their role in language teaching’. 

The project, which should have started in 2013, only had its kick-off meeting in 
June 2014 due to a series of institutional cutbacks, and is to end in June 2016. After 
the first year of implementation, the paper discusses the need for teacher training 
in technology-mediated TBLT, and looks at what has been achieved so far and how 
things are expected to evolve in the near future. 


2. Meeting practical challenges 

In several teacher training courses run by the higher education institutions that 
participate in the project, it has become evident that for the majority of trainees the 
principles and practices of TBLT still remain a challenge, despite the fact that most 
agree on the benefits of this approach at different proficiency levels and across 
different age groups, including adult education. A survey undertaken within the 
scope of the European Task-based Activities in Language learning: AGood practices 
Exchange (ETALAGE), another EU co-sponsored project, showed that teachers 
considered the lack of training opportunities, the absence of material and practical 
conditions, or even the difficulty in finding resources for developing materials 
and planning lessons, to be the major obstacles to an effective implementation of 
TBLT in schools (Lopes, 2012). Their reluctance is aggravated not only by their 
dependence on traditional methods, but also by the fact that examples of good 
practices that they can easily tailor to their needs - even more so if it involves ICT 
- are not easy to come by. 

PETALL is precisely trying to tackle these problems by (a) providing teachers 
with samples of good practices that can be used regardless of the language taught 
and of the age group being targeted, (b) offering teacher training courses in all the 
countries of the consortium, (c) disseminating the theory and practice of TBLT in 
schools, and (d) providing a virtual space to help teachers discuss and share ideas. 
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In addition to this, one of the project’s concerns is to make sure that the proposed 
samples can travel well from one country to the next and from one educational 
context to another without losing their pedagogical efficacy. That is why the project 
relies heavily on the transnational collaborative work between teachers, all of them 
coming from different cultural backgrounds, working within different education 
systems and teaching different languages. In order to facilitate such cross-cultural 
dialogue, the project has resorted to the CEFR as the conceptual tool that best 
provides a common ground for mutual understanding and for bridging the gaps that 
exist between education systems. 


3. Relevant literature 

The integration of ICT into TBLT is now receiving the attention of an increasing 
number of researchers. Little more than a decade ago, authors like Willis and Willis 
(2001), Ellis (2003), and Nunan (2004) laid down the theoretical and methodological 
foundations of TBLT. However, exploring the potential of technology was not their 
primary concern back then. The rapid evolution of ICT and its growing importance 
in everyday life have changed the ways in which human beings not only work and 
communicate, but also socialise and engage in new experiences. If, according to Ellis 
(2003), “a task is intended to result in language use that bears a resemblance, direct or 
indirect, to the way language is used in the real world” (p. 16), then the tasks proposed 
to the learners cannot be overlooked as the growing prevalence of ICT in their lives. 
Tasks, practical as they are, must emulate these ever-evolving technology-mediated 
contexts. One of the first volumes of studies on the integration of ICT and TBLT, 
Thomas and Reinders, appeared in 2010. It covered a wide variety of topics (use 
of computer-mediated communication in intercultural exchanges, network-based 
computer-assisted language learning, teacher training, and virtual-world learning 
environments). More recently, Gonzalez-Lloret and Ortega (2014) edited another 
volume dedicated to the use of ICT in TBLT activities. As they argue, “the canonical 
principles of task-based language teaching (TBLT) can be fitted integrally into the 
new language education and digital technology realities” (p. 1). 


4. Latest developments in the project and conclusion 

Each national tandem, formed by a practice school and a teacher training 
institution, has until now produced four tasks (40 in toto), which have already 
been trialled in the practice schools pertaining to the tandems of neighbouring 
countries. With the results of the trial (obtained from direct observation in school 
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settings, analysis of outputs, evaluation by end users), the tandems have been 
carefully revising the tasks before submitting them to a team of independent 
reviewers. The latter will evaluate them according to a series of pre-defined 
criteria (including its compliance with the CEFR, functionality, quality of 
planning, availability of resources, and clarity of the assessment procedures) (see 
also Lopes, 2015). Recommendations for improvement will then be incorporated 
into the tasks before they are translated into the consortium languages and made 
available in the project website at http://petallproject.eu. 

Besides a thorough description of each of the ten national courses offered by 
the teacher training institutions, the website will also feature all the products of 
dissemination and exploitation activities carried out to date by the consortium 
members. They include presentations at national and international conferences, 
papers published in journals, theses produced in the context of the project, and 
reports on meetings with the teaching staff of schools and university departments. 

Since one of the goals of the project is to foster transnational collaboration, the 
website also hosts a forum for teachers and trainees to exchange ideas, discuss 
practical issues and submit their own proposals of tasks to be added to the online 
project repository. On the other hand, national courses are also going to be scheduled 
in such a way as to allow trainees to engage in collaborative work with colleagues 
abroad. Common projects resulting from this work will be added to the repository. 

Another equally important initiative is the 2016 international conference at 
Granada University (Spain). It aims to (a) disseminate the project products amongst 
practitioners, through hands-on workshops and practical sessions, (b) discuss the 
latest investigation in the field, and (c) promote a debate between stakeholders 
involved in the design of language education policies not only in each country of 
the consortium, but also at European level. The starting point of the debate is a study 
based on an online survey to be carried out at European level aiming to ascertain: 

• the teachers’ perceptions of TBLT; 

• how willing they are to implement technology-mediated TBLT; 

• how much they know about the CEFR; 

• how much they still rely on more traditional approaches; 

• their training needs in this area. 

Only by the end of the project will it be possible to measure its reach and impact. 
However, from the preliminary results of its implementation, exploitation and 
dissemination, as well as from the feedback from stakeholders and end users, the 
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consortium expects to achieve the objectives successfully and to open new avenues 
for further research and actions. 
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Abstract. With massive utilization of Automated Writing Evaluation (AWE) 
tools, it is feasible to detect English as a Foreign Language (EFL) learners’ lexical 
application so as to improve their writing quality. This study aims to explore 
Chinese EFL learners’ lexical application to see if AWE-based writing can bring 
about positive effects of lexicon on linguistics features, especially in word count, 
word frequency and word density in their writing texts across a series of tracked 
revisions in University English classrooms and beyond. The findings from both 
classroom observations and learners’ responses to a post-test questionnaire survey 
reveal that they showed very positive perceptions of AWE-based writing in which 
they were greatly encouraged to make modifications in each writing task. It shows 
from data analysis of the writing texts that learners tended to replace simple 
lexical terms with more academic and concrete ones in revisions. The results 
signify implications for EFL learning of lexicon and writing, and also for AWE 
developers. However, it implies from the analytic features of lexicon that learners’ 
lexical modification was limited. This perhaps suggests for further research on 
learners’ lexical modification in AWE-based writing context to see if there is any 
difference across genders and different levels of achievers. 

Keywords: AWE, lexical application, modification, Pigai system. 


1. Introduction 

Learners’ writing proficiency partly depends on their lexical ability in terms of 
writing improvement, as writing consists of ‘grammaticalized lexis’ (Lewis, 1993). 
Lexicon, not merely a list of words, is conceived as “a set of lexical resources, 
including the morphemes of the language, plus the processes available in the 
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language for constructing words from those resources” (Trask, 1999, p. 111). In this 
study, lexical application ability refers to learners’ effective use of lexical items, 
including words and phrases, frequent collocations, institutionalized utterances, 
sentence frames and heads (Lewis, 1993). Previous research has proved a positive 
relationship of lexicon on language learners’ writing quality in terms of word 
range, word diversity, word frequency, and polysemy (Engber, 1995; Hu, 2015; 
Qin & Wen, 2007; Laufer & Nation, 1995). 

Recently, massive application of AWE tools has been expanded to language 
teaching and learning purposes, which has provided great potential possibilities 
for EFL learners to proceed with their writing tasks at their own rate with real¬ 
time feedback. Much research is reportedly promising and positive, where the 
utilization of AWE tools can be realized in terms of time efficiency, reduction of 
teachers’ workloads, increased learner autonomy (Sherimis & Burstein, 2013) and 
improved writing skills (Scharber & Dexter, 2008). This study aims to explore 
EFL learners’ lexical application to see if AWE-based writing has positive effects 
of lexicon on linguistic features based on their writing tasks on a web-based 
AWE tool, the Pigai system (http://www.pigai.org), which makes it accessible to 
keep precise track of any step in the creation of writing with real-time feedback 
in terms of vocabulary use, grammar, cohesion, and content relevancy. 


2. Method 


2.1. Research questions 

This study is driven by the following questions: 

• Is the AWE tool, the Pigai system, helpful for students to improve their 
writing skills, especially in terms of lexical application? 

• If yes, to what extent does the AWE-based writing affect students’ lexical 
application? If not, what are the causes? 

2.2. Teaching and research design 

The study was carried out in one-week intervals from September 2015 to 
January 2016 and it involves 26 second year non-English majors in Beijing 
University of Posts and Telecommunications’ English Audio-Video Speaking 
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Course (EAVSC), with a pre- and post-test design coupled with follow-up 
questionnaires in a digital lab. All of the students had passed CET-4 3 before taking 
the course but were still required to take a test of the same format of content-based 
integrated listening-speaking tasks through a self-developed web-based English 
language skills training system at the beginning and the end of the semester. 
During the whole semester, classes were conducted using the following pattern: 
students began every class by watching a video clip; next, engaged in synchronous 
computer-mediated group and pair discussions on the given topics; then proceeded 
with a ten minute online writing task on the same topic using the Pigai system; 
finally, performed a one minute recorded personal statement task on the same topic. 
The AWE-based ten minute writing task in class with an assigned topic each week 
served as an embedded task on a regular basis and students were allowed to revise 
their writing after class before a deadline set by the instructor. 

Figure 1. A screenshot of students’ writing submissions on the Pigai system 
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2.3. Data collection 

The questionnaires and interviews following pre- and post-tests were conducted 
and collected through the adopted system, which would provide insights into 
students’ perceptions of the Pigai system, particularly their feedback in terms of 
vocabulary, grammar, content and cohesion. All of the students submitted their 
pre-test questionnaire, but one missed the post-test questionnaire. All the students’ 
writing texts were collected and each modification or reconstruction was tracked 
through the Pigai system. 


3. CET is the abbreviated form of ‘College English Test’. The national College English Test Band Four—CET-4 in China aims 
to evaluate non-English majors’ comprehensive language proficiency. Apart from CET-4, there is also CET-6, which is widely 
used to evaluate above-average college students’ English language proficiency. 
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2.4. Data analysis 

There were 11 writing tasks during the whole semester which covered a variety 
of social issue topics, including job hunting, the relationship between tourism 
development and environmental protection, e-games, etc. 

In order to explore the students’ lexical application and the effectiveness of lexical 
modification in AWE-based writing, the multiple writing scores and lexical 
features of the three writing tasks (the first, sixth, and final ones) were selected as 
the research samples in the current study. The scores data were processed using 
SPSS 22.0 to see if there is a significant difference in the first and final draft in 
each of the three writing tasks. 

To investigate students’ lexical application across multiple drafts and their 
lexical modification in AWE-based writing, the Coh-metrix tool (Graesser, 
McNamara, Louwerse, & Cai, 2004) was employed as a complementary tool 
for analytic features on texts. 

The web-based Coh-metrix, developed by the University of Memphis, automates 
over 200 measures of language, discourse and cohesion through extracting 
information from texts. Change in lexicon use can be seen from the measured 
scores of texts calculated with Coh-metrix, including word count, word length, 
word frequency, and lexical richness across multiple writing results. 


3. Results and discussion 

3.1. Analysis of AWE-based writing scores 

The average number of revision times of the 11 writing tasks is 5.12 to 13.42 (in 
the seventh task). Although it drops to 6.81 in the final task after 12.69 for the 
tenth task (probably because it was close to the final exam session), as shown in 
Table 1 , students in the mid and final writing tasks still conducted more revisions 
than they did in the first task. 

The results of the students’ writing scores basically fit the normal distribution and 
paired sample t-tests revealed a significant difference in scores between the first 
and the final drafts for all of the three writing tasks in the study (tfirst task= -6.06, 
p <0.05; tsixth task= -5.50, p<0.05; tfinal task= -7.34,/><0.05). 
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Table 1. Paired sample t-test of scores for students’ drafts 



N 

Average 
times of 
revision 
drafts 

Mean Scores 


First draft 

Final draft 

MD 

t 


M 

SD 

M 

SD 


First writing task 

26 

5.12 

70.06 

9.78 

75.90 

8.11 

-5.84 

-6.06* 

Sixth writing task 

26 

7.31 

69.04 

12.74 

78.50 

8.22 

-9.46 

-5.50* 

Final writing task 

26 

6.81 

63.83 

7.28 

72.25 

7.45 

-8.42 

-7.34* 


Analytic features of students’ perceptions 

With respect to how students perceive the Pigai system in affecting their writing 
quality, from the questionnaire feedback, 84% students considered that for each 
revision they valued the score provided by the system, and only 20% of them thought 
they would cease modification if they get a lower score after their modification. 
68% of them showed gratitude to the real-time and multiple comments which 
helped them realize their weaknesses and pushed them to rewrite or revise. 

3.2. Analytic features of lexicon 

As is shown in Table 2, the paired sample t-test results revealed that there was no 
significant difference between the first and the final draft both in average word count 
(t=-1.89,/>>0.05) and word frequency (t=0.67,p>0.05). The word frequency count 
was based on CELEX, the database from the Dutch Centre for Lexical Information 
(Baayen, Piepenbrock, & Gvdikers, 1995). For the average word length, students 
chose longer words in their final drafts than those in their first drafts (t= -4.44, 
p<0.05), indicating that they possibly used more academic or formal words in the 
process of revision. 


Table 2. Analytic features of the final writing task 


Linguistic features 

N 

Drafts for the final writing task 


First draft 

Final draft 

MD 

t 

Average word count 

26 

138.80 

159.35 

-20.54 

-1.89 

Average word length 

26 

4.14 

4.26 

-0.12 

-4.44* 

Word frequency 

26 

3.08 

3.07 

0.01 

0.67 

Type-token ratio 

26 

0.62 

0.60 

0.02 

1.49 

Connective incidence 

26 

103.63 

1.09.39 

-5.75 

0.013* 


Note: *p<0.05 
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Type-token ratio is very important to measure the lexicon richness, for a low ratio 
usually indicates that words are repeated many times. Table 2 shows that type- 
token ratios of the first and the final draft had no significant difference (^=1.49, 
p>0.05). However, the results revealed a significant difference in connective 
incidence (t=0.013, p<0.05). The higher the incidence of connectives, the more 
it is assumed that students applied connective words and phrases in their final 
drafts. 


4. Conclusions 

The findings from the research showed that students appreciated and valued the 
real-time feedback provided by the Pigai system and they were highly motivated 
and encouraged to make modifications for each writing task. They tended to 
replace simple lexical items with more academic and concrete ones. Nevertheless, 
the analytic features of lexicon implied that their writing improvement was 
limited, and this perhaps requires for a further study on textual analysis in depth 
so as to better explore their modification tracked by the Pigai system to see 
if there is any difference across genders and among different English levels of 
students. 
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Mobile-assisted language learning 
and language learner autonomy 

Paul A. Lyddon 1 


Abstract. In the modem age of exponential knowledge growth and accelerating 
technological development, the need to engage in lifelong learning is becoming 
increasingly urgent. Successful lifelong learning, in turn, requires learner autonomy, 
or “the capacity to take control of one’s own learning” (Benson, 2011, p. 58), 
including all relevant decisions about what, when, where, and how to learn. Mobile 
technologies, as not only potential means for learning anywhere and anytime but 
also conduits to rich, multimodal content, provide unprecedented opportunities 
for the development of learner autonomy. However, even when learners possess 
adequate training in mobile technology use and autonomy itself, implementation of 
mobile learning devices in the classroom often seems to engender little additional 
autonomous behavior. This paper highlights the differing constraints on learner 
autonomy in formal and infomial learning environments. It then proposes an 
approach to encouraging greater demonstration of autonomy through an explicit 
linking of institutional requirements associated with routine lesson assignments and 
the achievement of personally meaningful, individually determined learning goals. 
Finally, it suggests the role that mobile technology can and properly ought to play 
in capacitating consistently high levels of demonstrated autonomy both inside and 
outside the classroom. 

Keywords: lifelong learning, mobile technology, learner training, learning context. 


1. Introduction 

As the rate of technological advancement continues to accelerate, the exponential 
growth and rapid dissemination of new knowledge now makes many traditional 
academic courses of study out-of-date almost as soon as they reach completion. As 
such, lifelong learning can no longer be considered the recreation of an exceptional 
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few who happen to possess the necessary resources and disposition, but an absolute 
imperative for all who wish to be gainfully employed for the duration of their 
working years. For lifelong learning to be successful, however, learners need to 
possess a high degree of autonomy, in other words, the capacity to take control 
of their own learning (Benson, 2011, p. 58). This capacity includes determining 
learning objectives, defining scope and sequence, selecting methods and techniques, 
setting locations and schedules, and evaluating outcomes (Flolec, 1981). 

The invention and spread of Internet-capable mobile devices such as smartphones 
and tablet computers has certainly opened up new possibilities in terms of 
learner autonomy by providing not only a potential means of learning anytime 
and anywhere, but also access to a virtually endless variety of rich, multimodal 
content. However, a means in itself is insufficient. At a minimum, it also requires 
the ability to use it. Consequently, countless learner training programs have 
now been put in place, and many of these include mobile technologies as a key 
component. 

Possession of mobile learning devices and demonstrated ability to create and 
successfully complete individualized learning plans entailing their use outside 
of class notwithstanding, learners often fail to exhibit similar levels of autonomy 
inside the classroom. For instance, in an activity where a simple image search 
might help them either understand or express an essential concept during a class 
discussion, they inexplicably choose instead to flounder. The purpose of this paper 
is to suggest a plausible reason for the inconsistent display of autonomous behavior 
between formal and informal contexts and to propose an approach to rectifying this 
apparent discrepancy. 


2. Background 

Though their exact origins are difficult to pinpoint, discussions of autonomy 
in education greatly intensified in the wake of the social and political turmoil 
immediately following World War II (Gremmo & Riley, 1995). By the early 1970s, 
initiatives such as the Council of Europe’s Modern Language Project had emerged to 
provide opportunities and support for lifelong learning so as to nurture individuals’ 
abilities to responsibly participate in the affairs of modern society (Benson, 2011). 
Given the rapid pace of technological change in the current digital age, the need 
for learner autonomy is now crucial, for students must now be prepared for “jobs 
that don’t yet exist, using technologies that haven’t been invented, in order to solve 
problems we don’t even know are problems yet” (mesjms, 2016). 
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The adoption of mobile devices such as smartphones and tablet computers 
has largely eased restrictions on where and when learners can learn as well as 
introduced a host of previously unavailable options in terms of modality and 
content. Moreover, inasmuch as they are technological artifacts, these devices 
might even be qualified as extensions of our mental and physical faculties (Brey, 
2000). Just as glasses improve our ability to see, smartphones and tablets have the 
potential to help us observe and recall things better, fill gaps in our knowledge, 
and enhance our ability to communicate. As such, with the inclusion of training 
on how to take advantage of them in learner training programs, these powerful 
technologies should additionally lead to greater learner autonomy. However, the 
results are not always consistent, and the question is why. 


3. Discussion 

True learner autonomy, in the sense of self-determination, would include not only 
what, where, when, and how to learn, but whether to learn at all. While it is true 
that students cannot choose whether to learn if they do not know how, it must 
also be admitted that most formal language learning is compulsory and that many 
students might indeed opt out if given the choice. Despite the Common European 
Framework of Reference for languages (CEFR)’s explicit acknowledgment of 
the importance of learner autonomy, the Council of Europe (2014) explains 
the framework’s overall purpose as “to provide a transparent, coherent and 
comprehensive basis for the elaboration of language syllabuses and curriculum 
guidelines, the design of teaching and learning materials, and the assessment of 
foreign language proficiency” (para. 1). In other words, learners are not, in fact, 
free to simply learn whatever they like, at least not if they wish to meet international 
program standards. 

Learner autonomy in most formal learning contexts is limited in a number of other 
important ways as well. Among the most evident are time and place, ironically 
the two constraints that mobile technologies are touted to overcome. Perhaps the 
most serious additional impediment of formal learning contexts with respect to 
learner autonomy, however, is that of tool use itself. While no teacher would likely 
prohibit students from wearing glasses in class, it is largely because the intended 
purpose of glasses is clear and the potential for its perversion is slight. The purpose 
of versatile tools such as mobile devices, on the other hand, is ambiguous and, 
thus, invites misuse in the form of off-task student behaviors. Thus, it is for this 
reason, I would argue, that many instructors do not allow the use of mobile devices 
in their classrooms. Moreover, the mindset of formal schooling is so strong that 
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even in classrooms where teachers do not expressly prohibit their use, students are 
conditioned to assume prohibition unless explicitly told otherwise. Consequently, 
despite having the means and ability, they fail to demonstrate autonomy out of a 
perceived denial of permission. 

Not to challenge the notion of standards-based education, I simply wish to 
acknowledge the constraints of formal learning contexts and suggest a way 
of working within them. In any context, learner autonomy consists more of 
interdependence than independence, but especially in a formal context, I would 
contend that autonomous learners should possess the following five characteristics: 
compliance, competence, cognizance, introspection, and diplomacy. 

These five characteristics can be imagined on a horizontal cline, with increasingly 
autonomous learners exhibiting more of them from left to right. The least 
autonomous students are non-compliant, that is, they choose not to participate in 
assigned learning activities. Those who are compliant but incompetent participate 
but may not follow the prescribed requirements out of lack of understanding and 
failure to seek clarification. Those who are only additionally competent follow 
the assignment directions to the letter while sometimes awkwardly violating 
the intended pedagogical purpose. Those who are additionally cognizant also 
understand the teacher’s rationale, those who are introspective can see the 
personal value of the assignment, and those who are diplomatic can negotiate task 
completion accordingly. 

After clearly highlighting to students the necessarily limited nature of learner 
autonomy in the formal learning context, the first step in developing it is to inculcate 
these expected characteristics, for instance by engaging learners in regular self¬ 
reflection on their level of conscious involvement in the completion of required 
learning assignments. It is only at this point that the role of mobile technology 
in bolstering learner autonomy can truly be addressed, for only then can students 
begin to see the value of the technology in helping them to achieve their personal 
goals, understand how use of the technology is consistent with instructional, 
institutional, or societal goals, and use the technology conscientiously to mediate 
these two sometimes competing ends. 


4. Conclusion 

As technological artifacts can be considered extensions of our physical and mental 
faculties, mobile technologies open up promising new possibilities in terms of the 
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exercise of learner autonomy. However, compulsory learning in formal contexts 
may inhibit their full exploitation in the classroom. To help learners overcome their 
inhibition, teachers should explicitly acknowledge the limited nature of autonomy 
in formal learning contexts and inculcate expectations of learner characteristics 
aimed at linking the institutional requirements associated with routine lesson 
assignments to the achievement of personally meaningful, individually determined 
learning goals. Finally, they should encourage the development of a new type of 
self-awareness and self-discipline that embodies mobile technologies and, thus, 
enables them to be effectively employed to further this purpose. 
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Abstract. The community platform Young/Teen English Language Learners (YELL/ 
TELL), as mentioned by Bortoluzzi and Marenzi (2014) was “developed to respond 
to the needs of collaboration and sharing among trainee teachers, school teachers, 
teacher trainers and researchers in the field of language learning for English [as 
a Foreign or Second Language (FL/SL)]” (p.182). The current study focuses on 
ethnographic observation and data gathered during a workshop for professional 
development organised for experienced teachers. We compare the evidence of the 
teachers’ actions, with the analysis of their perception about their professional use of 
the online environment and their critical reflection about the experience. 

Keywords: teacher professional development, lifelong learning, collaboration, 
evaluation-driven approach. 

1. introduction 

The social community YELL/TELL, supported by the Learn Web 4 social platform, 
has the aim of encouraging professional collaboration among teachers of different 
school levels and backgrounds. Lifelong learning and peer-teacher education are 
promoted on the basis of sharing resources and commenting and reflecting on them 
in the spirit of co-construction of knowledge through open-educational practices 
and resources for teaching English as a FL/SL. 

This paper is based on an ethnographic observation and qualitative study of the 
activities carried out in the online community during a blended professional 
development workshop for experienced school teachers in Italy. The research 
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aim is two-fold: (1) investigating how a group of experienced teachers perceive 
the participation in a professional online community for their professional 
development, and (2) identifying the affordances of the platform that enhance 
professional development and improve on the system design. 

The study followed the progress of 16 experienced teachers of primary and lower 
secondary schools during a blended workshop in which the current version of the 
platform was used to share open access resources and practices, collaborate online 
and improve on the professional digital skills of searching, selecting, annotating, 
customising and uploading online resources for English language learning and 
plurilingualism. The evidence of the teachers’ actions within the online environment 
(logs) were analysed in context along with their discussions about the use of the 
system and their critical reflection on the experience (comments on the forum and 
the final questionnaire). 


2. Method 

2.1. The online platform and community 

The YELL/TELL community platform allows users to share and collaboratively 
work on resources collected from the web or teacher-generated; resources can 
be bookmarked, tagged, rated, and discussed by all users who join the different 
interest groups (Marenzi & Zerr, 2012). Users can create folders “to bundle 
resources that belong to the same learning context, [... hence,] collaboratively 
identify the best learning resources for specific learning domains” (Abel, 
Marenzi, Nejdl, & Zerr, 2009, p. 158; see also Bortoluzzi & Marenzi, 2014). 
Different groups of users have been involved in the co-design of the platform 
(Wang & Hannafin, 2005) from the start (2012), which allows us to carry out 
throughout the years an iterative evaluation-driven design-based research 
approach (Marenzi, 2014; Mirijamdotter, Somerville, & Holst, 2006). 

The online community supported by the platform is an inclusive, boundary¬ 
crossing professional community used for pre-service, in service and lifelong 
language teacher education for teachers of nursery, primary and secondary schools. 
Participants also include teacher educators, university lecturers and computer 
developers. The community was developed within a flexible socio-constructivist 
framework as a technology-supported community to contribute to the quality of 
the teaching profession “by encouraging collaboration and knowledge exchange” 
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(Vuorikari et al., 2012, p. 7), to multiliteracy for teachers (Cope & Kalantzis, 2009) 
and to enhancing reflection on practice and theory (Edge, 2011). 

2.2. The blended in-service professional development workshop 

The workshop was organised in Pordenone (Italy) and lasted from September to 
December 2015 for a total of 14 contact hours and tasks for individual online work. 
Participants were primary and lower secondary school experienced teachers and 
had very diversified digital skills (from beginners to competent). None of them had 
ever used the YELL/TELL platform before and the majority were new to digital 
assistance as a teaching aid. Tasks were designed to get the teachers to do hands- 
on work: post materials online, share resources and teaching experiences, discuss 
teaching practices and the affordances of the platform. 

The general aim of the workshop was to reflect on online collaboration for teaching 
and plurilingual education. From the technical point of view, the research goal was 
to collect information about teachers’ online practices (such as searching, selecting, 
annotating and customising online resources) and improve on the system interface 
in support of teaching scenarios. 

2.3. Data analysis 

The data gathered is both hard evidence of actions (logs) and qualitative ethnographic 
observation as well as qualitative evaluation in context (forum participation, task 
completion and final questionnaire). In fact, we found a contrast between these two 
sets of data: whereas the first (1. below) would point towards a rather limited use 
of the platform, the second (2. below) yields a rich, involved and personalised use 
of the platform. 

1. Activity logs were used to study the search behaviour: how teachers 
refined their search queries, whether they liked the resource pool returned 
by the system and whether they encountered some problems while working 
with the system. A quantitative analysis of the logs showed that teachers 
issued 840 search queries across the search types Image, Web and Video. 
Teachers uploaded 262 resources out of which 66% from their personal 
workstation and 34% added through searching on the platform. 30% of the 
resources added through search were found in the YELL/TELL platform 
(not on the Web) as they had been previously added by other users, and 
were appreciated by the teachers as valuable to be reused in their learning/ 
teaching context. We know from the feedback questionnaires (2. below) 
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that one of the reasons why several teachers were more inclined to share 
resources from their own desktop was that they felt more confident while 
sharing a familiar resource, because they had already used and tested 
it in their teaching practice. Search logs show that sometimes teachers 
searched for the same query multiple times by either refining the search 
query itself or by using various search filters. Based on the logs analysis, 
a few improvements were suggested, and a questionnaire was designed to 
investigate the observed patterns better. 


2. Forum participation and task completion demonstrated the group 
and individual commitment in using the platform and its affordances: 
experienced teachers appreciated to be part of a community of like- 
minded people with whom they could share resources, practices and 
discuss problems. They praised the fact that resources they can find 
on the platform are already qualitatively selected and organised by 
teachers like them and educational experts. They discussed how to tag 
and annotate resources collaboratively in order to sort and find resources 
easily, suggesting that a more professionally related tagging system 
should be put in place. Teachers appreciated the social aspect of the 
online community and the ease with which it is possible to share and 
collaborate through commenting, discussing in the forum and creating 
documents collaboratively. 


3. Discussion 

On the one hand, the hard evidence of logs is limited in range and shows repetitive 
or incomplete actions: teachers searched for resources, but then uploaded new ones 
mainly from their desktop; and some uploaded many times the same resource or 
keyed in strings with errors to search for resources. On the other hand, the ‘soft 
evidence’ and ethnographic observation (participation in the discussion online 
and offline, forum, quality of tasks and final questionnaire) show, instead, a very 
involved, motivated, personalised and creative group of teachers who explored 
and critically discussed resources (for teaching or professional improvement), 
and provided useful remarks and suggestions for platform improvement such 
as pre-designed categorisation of resources, improved group design, and 
system documentation. Their suggestions were so relevant that we are currently 
implementing new features in the system: better search categorisation, a tagging 


310 




YELL/TELL: online community platform for teacher professional development 


system suited to the professional community of teachers, and My resources as a 
space that functions as a personalised laboratory and sandbox. 

The difficulties with handling platform functionalities, which resulted in limited 
log data, were due to the general low level of digital skills and lack of experience as 
members of a professional online community. Practical difficulties were overcome 
thanks to the high level of motivation and involvement. The platform design will 
profit from the teachers’ constructive and professional feedback. 


4. Concluding remarks and further developments 

The two-fold aims of the study were met beyond expectations: the experienced 
teachers who participated in the workshop confirmed the relevance of professional 
development through online collaboration in a community for professional 
development. Experienced teachers gained confidence in digital skills, in their 
professional competence, and actively contributed to improving the system design 
and the use of the platform. The participants also decided to organise teacher¬ 
training meetings in their different schools to share the experience and the expertise 
they acquired during the workshop. Thus, these experienced teachers have become 
teacher educators and will promote digital and professional competence through 
the online community. 

Research and practice on the YELL/TELL platform and community are ongoing; 
we aim to promote internationally this expanding teacher community. 
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Abstract. This study investigates the use of Automatic Speech Recognition (ASR) 
systems to epitomize second language (L2) listeners’ problems in perception of TED 
talks. ASR-generated transcripts of videos often involve recognition errors, which 
may indicate difficult segments for L2 listeners. This paper aims to discover the root- 
causes of the ASR errors and compare them with L2 listeners’ transcription mistakes. 
Our analysis on the ASR errors revealed several categories, such as minimal pairs, 
homophones, negative cases, and boundary misrecognition, which are assumed to 
denote the challenging nature of the respective speech segments for L2 listeners. 
To confirm the usefulness of these categories, we asked L2 learners to watch and 
transcribe a short segment of TED videos, including the above-mentioned categories 
of errors. Results revealed that learners’ transcription mistakes substantially increase 
when they transcribe segments of the audio in which ASR made errors. This finding 
confirmed the potential of using ASR errors as a predictor of L2 learners’ difficulties 
in listening to a particular audio. Furthermore, this study provided us with valuable 
data to enrich the Partial and Synchronized Caption (PSC) system we proposed 
earlier to facilitate and promote L2 listening skills. 

Keywords: automatic speech recognition, listening skill, error analysis, partial and 
synchronized caption. 


1. Introduction 

Among the four skills that play crucial roles in L2 learning, listening is of 
paramount importance for being a prerequisite of speaking and for providing the 
language input (Rost, 2005). Mastery in listening needs exposure to authentic 
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audio/visual input, which in turn makes the listening process more difficult. The 
main reason lies in the fact that listening is a complicated process, from perceiving 
the speech to comprehending the content, and when using authentic materials, L2 
listeners are more likely to encounter difficulties and make recognition mistakes 

(Gilmore, 2007). 

Despite a body of work (Bloomfield et ah, 2010; Revesz & Brunfaut, 2013) on 

L2 listening difficulties, there is no reliable resource to detect those segments 
of an audio/visual material that cause recognition difficulties for L2 listeners. 
Motivated by this demand, we decided to find a means for discovering these 
difficulties in order to scaffold the language learners. Undoubtedly, L2 learners, 
in accordance with their language proficiency level and individual skills, 
may encounter different types of problems in recognizing speech. However, 
certain factors are more likely to result in misrecognition for the majority of 
L2 learners. 

Detecting difficult words and phrases in audio/visual material is initially developed 
in our work (Mirzaei, Meshgi, Akita, & Kawahara, forthcoming), the PSC system. 
PSC identifies difficult words in TED talks and presents them in the caption while 
hiding easy ones to encourage listening over reading. The PSC system detects 
difficult words based on high speech rate, low word-frequency, and specificity 
(specific or academic terms). Nevertheless, these factors alone may not encompass 
all problematic speech segments in different videos. 

To consider other factors, this study aims to establish the viability of using ASR as 
a predictor of L2 listeners’ problems. ASR systems can generate transcriptions of 
spoken language, but this transcript often involves some errors. Despite common 
criticisms that regard these errors as major drawbacks of ASR systems, this paper 
investigates their usefulness to discover challenging speech segments of TED talks 
and to seek means for enhancing the PSC system. 


2. Method 

The Julius ASR system was used to transcribe 72 TED talks; the ASR errors were 
derived from the system and given to a linguist expert to perform a root-cause 
analysis. These errors were then compared with PSC’s selected words to show in 
the caption. Since PSC also chooses difficult words for L2 listeners based on speech 
rate, frequency and specificity factors, some overlaps are anticipated, while some 
mismatches can also be detected (Figure 1). These mismatches are automatically 
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extracted and further analysed by the expert to discover the challenging speech 
segments that are not yet handled by the PSC system (dashed area in Figure 1). 


Figure 1. Diagram of the PSC shown words vs. ASR error categories: dashed 
area presents the scope of analysis 


PSC Show: 


ASR Errors: 


High Speech Homophones 

Rate Low Minimal Pairs 

Frequency Negative Cases 

Specific Words Breached Boundaries 
Impotent Factors 


Expert analysis on these ASR errors revealed several clusters, four of which seemed 
to be the prudent sources of listening difficulties for L2 learners: homophones, 
minimal pairs, negative cases and breached boundaries. 

Flomophones (e.g. plain/plane) and minimal pairs (e.g. face/faith) hinder 
recognition processes by activating several word candidates (Weber & Cutler, 
2004) and imposing high-level semantic analysis to select the right choice. 
Moreover, the wrong choice of words may thoroughly change the meaning of 
the sentence and deteriorate the comprehension. The same argument can be 
made for negative cases (e.g. can/can’t). Finally, breached boundary (i.e. wrong 
lexical segmentation) is perhaps the most important category of errors that are 
very likely to arise when L2 learners watch a video; identifying word or phrase 
boundary is a challenging part of L2 listening (Field, 2009). A number of factors 
can be responsible for wrong lexical segmentation, including, assimilation, 
stress patterns, frequency rule and resyllabification (Cutler, 1990; Field, 2003). 
Regardless of their causes, breached boundary occurrences are hard to be 
predicted. ASR errors, however, provide helpful clues to detect such kinds of 
potentially misrecognized boundaries. 


3. Experiment 

A transcription experiment is conducted to verify whether these four categories 
of ASR errors are actually problematic for L2 listeners. The data from this 
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experiment allows comparing ASR errors to those of L2 learners’ recognition 
mistakes. 

The participants of this study were 11 Japanese and 10 Chinese students who 
were undergraduates and graduates majoring in different fields. All participants 
were intermediates with TOEIC scores (or equivalents) of above 650. There were 
8 female and 13 male students. 

The material of this experiment included twenty talks selected out of 72. The 
selected videos were delivered by native American English speakers in order 
to exclude the effect of other accents (e.g. British English). Two segments were 
chosen from each video: 

• one including four ASR error categories which PSC hid (‘difficult’ cases 
that PSC failed to predict); 

• one including ASR correct cases which PSC hid (‘easy’ cases both for 
ASR and PSC). 

The former involved minimal pairs, homophones, negative forms, and breached 
boundaries and were tested to identify the difficulty-level of these categories. The 
latter were chosen to compare the performance of L2 listeners on transcribing easy 
versus potentially difficult speech segments. 

Each segment of the video lasted 25~35 seconds and stopped at an irregular 
interval, which ended with 4~6 words, including the target word (easy or difficult 
case). Irregular pauses were made manually to maintain real life listening and avoid 
word-by-word decoding. The participants were not aware of when the videos were 
going to stop or which word would be the target word. They could watch each video 
only once and were supposed to type the last few words they heard immediately 
after the pause. Limited time was set to avoid overthinking and analyzing, thereby 
allowing the participants to input what they recognized. The test was made using 
iSpring Quiz Maker and was launched online. Spelling errors were ignored, unless 
affecting the meaning. 


4. Results 

The results of this experiment include the scores of the participants on transcribing 
the easy segments of the videos versus the difficult parts that included minimal 
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pairs, homophones, negative forms, and breached boundaries. As Figure 2 (Right) 
illustrates, the mean scores of the students on the easy segments (/V/—0.85, SD=0.0S) 
is much higher compared to the difficult segments (Af=0.16, SD=0. 18). 

Figure 2. (left) Overall average scores on ‘easy’ vs. ‘difficult’ segments, (right) 
Detailed result on four subcategories of ASR errors vs. respective 
easy segments 


100 % 100% 



"Easy" "Difficult" ■ "Easy" Video Segments ■ "Difficult" Video Segments 

The results of a t-test indicate that this difference is statistically significant 
(t(19)=18.131; p<.05). Figure 2 (left) also suggests that participants’ average 
scores on each of the categories of errors, i.e. minimal pairs (M=. 12; SD=. 22), 
homophones (M=.14, SD=.ll), negative cases (M=.ll, SD=.l8) and breached 
boundaries ( M=.20 , SD=. 21) were statistically lower than their average scores on 
respective easy segments of the videos. Interestingly, similar mistakes were found 
in participants’ transcriptions and ASR generated transcript (e.g. “make a new ear” 
was transcribed as “make a new year” by both ASR and the participants). 


5. Conclusion 

The study investigated the use of ASR errors in detecting challenging speech 
segments of TED talks and improving the word selection criteria in PSC. Following 
a thorough root-cause analysis, it was found that several categories in the ASR errors 
suggest the difficulties for L2 listeners. These categories included homophones, 
minimal pairs, negative forms, and breached boundaries. An experiment with L2 
listeners confirmed the feasibility of using these ASR errors to predict L2 speech 
recognition difficulties. This finding can provide means for future advances of 
the PSC system by exploiting ASR clues to optimize the choice of words in the 
caption. In this view, the enhanced version should be compared with the current 
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one to investigate any improvement. Furthermore, discovering challenging speech 
segments allows the learners to identify their listening problems and provide the 
teachers with useful information to better scaffold the learners. 
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Abstract. This research is motivated by the emergence of virtual technologies 
and their potential as engaging pedagogical tools for facilitating comprehension, 
interactions and collaborations for learning; and in particular as applied to learning 
second languages (L2). This paper provides a descriptive analysis of a case study 
that examines affective learning outcomes. We present an extension of an Affective 
Learning Model (ALM) in light of gaming in a 3D Virtual Learning Environment 
(VLE) in support of an L2 course. We identify affordances while applying an 
example of a serious game within the selected VLE. The findings of this case 
investigation give evidence that the gaming activities supported affective learning 
outcomes. This finding aligns with prior research of the ALM. Our research is based 
on a set of data collected during a case study as part of Euroversity, a three-year 
European Commission Project (2011-2014). 

Keywords: virtual learning environments, OpenSim, affective model of learning, 
affordances, gaming. 


1. Introduction 

In education and language learning, the main arguments for the use of virtual 
technology are that 3D environments are engaging as media; facilitating 
comprehension, interaction, and collaboration by the means of situating learning 
materials in an immersive context (Roussou, Oliver, & Slater, 2006). Research 
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shows that learning in VLEs is an emerging trend and can provide a more effective, 
motivating way of learning than traditional classroom practices (Duncan, Miller, 
& Jiang, 2012; Monahan, McArdle, & Bertolotto, 2008). However, VLEs on their 
own cannot serve as effective learning aids. Pedagogical tools and training in the 
use of such tools within those contexts need to be developed to meet learners’ 
needs. More recently, the application of serious games has been studied as the 
use of the ‘game mechanism’ to facilitate the structured delivery of the learning 
objectives to the targeted groups of learners. Gee (2007), for instance, identified 
36 principles of well-designed games that foster learning. These include fostering 
an environment for practice, transfer of formerly learned skills, and scaffolding of 
skills. In this paper, we propose these principles are expressed in the affordances 
of VLEs. We present an extension of an ALM in light of gaming in 3D VLE. We 
show evidence that the game in the VLE may offer support for affective learning 
outcomes for learning a second language. 


2. Method 

This research stems from a three-year funded network proj ect entitled Euroversity. 
The Pan European multidisciplinary project (2011-2014) was comprised of 
18 partners, including educators, foreign language instructors, and researchers in 
various fields across Europe. Practitioners strove to develop a set of supportive 
resources and guidelines for educators in the process of devising productive and 
immersive learning experiences in VLEs. Data in this paper were collected during 
an interview (2011) and follow-up interview (2012) on Skype with the Austrian 
teacher of the case study course and was recorded using the screen recording 
software Camtasia. Evidence in this study is identified from these interviews. 
We apply a descriptive analysis, examining the course of ‘Chatterdale’, using 
Robbins et al.’s (2004) ALM. We select this model because as O’Neil, Wainess, 
and Baker (2005), although he identified classification schemes of learning 
outcomes according to the cognitive learning outcomes that they support (e.g. 
repetitive task, memory, and exploration), speculates that research is needed on 
models of learning that include the affective learning outcomes. In particular, it 
is suggested that game elements that interact with the instructional environment 
may support learning outcomes. In Robbins et al.’s (2004) AML, the learning 
outcomes are based on constructs of academic goals, self-efficacy, effort, play 
and test anxiety. 

The serious game here is also identified as an epistemic game; an epistemic game 
relates gameplay objectives and constructs to knowledge or the formalisation 
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of certain cognitive concepts within an epistemological L2 context. The game 
construct was an alien mystery designed to unfold in the virtual village of 
Chatterdale in the multi-user VLE of OpenSim. The teacher designed the virtual 
village by combining elements from the students’ imagination and a suburban 
community setting. The Austrian teacher and her Norwegian colleague invited 
groups of thirteen-year-old Austrian and Norwegian students to explore the 
virtual community of Chatterdale and become acquainted with the resources of 
this virtual setting. 

Twelve students were assigned to three groups of size four. Each group had two 
Austrian students and two Norwegian students. During their visit to Chatterdale, 
students only encountered their peers and instructors and no other persons in the 
VLE. This prompted them to raise the question: what happened to the residents of 
Chatterdale? Inspired by students’ inquiries about the local residents, the teacher 
utilised the semiotic resources of this game-mediated setting to design game-play 
driven quests where students would interact and collaborate by asserting the role 
of local investigators baffled by the disappearance of the Chatterdale residents. 

As investigators of a potential crime scene, students would collaboratively 
piece together clues about the disappearance of the Chatterdale residents. We 
extend the ALM model by introducing the third column (Table 1), proposing that 
affordances enacted in 3D VLEs can support the Affective Learning Constructs 
(ALC). 


Table 1. Extending Robbins et al.’s (2004) ALM 


ALC 

Meaning 

Proposed affordances of serious 
games in virtual environments 
that support ALC 

Academic goals 

Learner’s actions or goal- 
directed behaviour 

Ability to repeat training (persistence 
of the virtual learning context) 

Self-efficacy 

Learner’s view of their 
own abilities to succeed 

Dynamic view of abilities 
through real-time interaction 
with others in VLEs 

Effort 

Learner’s extent of 
work on a task 

Support of scaffolding 
through recordings of virtual 
sessions (e.g. machinima) 

Play 

Learner’s actions without fear 
of consequences (for fun) 

Control over virtual profile (e.g. 
supports possible actions with 
consequence to real-self) 

Test anxiety 

Learner’s cognitive concern 
(e.g. on performance) and 
emotional reaction (e.g. panic) 

Safe learning environment 
(e.g. no risk or physical harm, 
ability to leave emotionally 
stressful virtual situations) 
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3. Results 

We identify affordances that were evident in the actual case of learning in 
Chatterdale and the affective constructs, as extracted from the interview data, 
see Table 2. We find that the VLE enacted support of affective learning outcomes 
in L2. The interview data for this case is described in greater detail in Hadjistassou 
and Molka-Danielsen (2016). 


Table 2. Affordances perceived in a case example that support ALC 


ALC 

Affordances perceived by the instructor of the 

Chatterdale case study that support ALC 

Academic goals 

Students’ persistence in enhancing their oral skills in L2 
by participating in an epistemic game to solve an alien 
mystery and discover the events that had transpired and 
that had led to the Chatterdalers’ disappearance 

Self-efficacy 

Austrian and Norwegian high school students’ capacity to succeed 
in solving the mystery and enhancing their oral skills in L2 

Effort 

Extent to which Norwegian and Austrian students 
strove to uncover clues and solve the alien mystery 
while engaging in oral interactions in L2 

Play 

An intriguing and entertaining game play scenario involving 
an alien mystery, the disappearance of the Chatterdalers. 

Students were invited to become private investigators to 
solve the mystery without any trepidation or fear 

Test anxiety 

Eliminated test anxiety and emotionality through the 
use an epistemic game and a final reflective written 
assignment rather than promoting other assessment 
techniques that would have enhanced students’ anxiety 


4. Discussion and conclusions 

This study demonstrated that the game-play nature of the Chatterdale village 
generated multiple and complex affordances that contributed towards students’ 
enhancement of oral proficiency in the target language, English. Aligning with 
Zheng (2012) and Haines (2015), new affordances emerged as L2 educators 
integrated this game-play in the VLE and students engaged and participated in 
constructive game-oriented interactions. The students’ aim to solve the mystery 
pursued shared academic goals to complete the goal-driven task. Self-efficacy 
of students was evident in commitment in solving the mystery, and enhancing 
oral skills warranted their need to engage in deductive thinking, and explore and 
interact with the semiotic resources. In terms of effort, affordances were enacted 
during students’ attempt to uncover the mysterious conditions that had led to the 
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Chatterdale residents’ disappearance, mediated by their oral exchanges and goal- 
driven tasks. The play was based on students’ personal interests, and inquiries 
involved imagination, mystery, crime, and private investigation in a VLE. The 
game-play scenario and the multiple semiotic resources, including the goal-directed 
tasks, enacted affordances for promoting learning outcomes, i.e. promoting oral 
interactions in English among students. Students did not experience any test anxiety 
since the emphasis was placed on the collaborative nature of the activity and the 
need to compose a collaborative reflective letter or report instead of introducing 
formative or summative assessment techniques that would have contributed to 
enhancing students’ level of anxiety. 

The findings of this study can guide language educators in framing and investigating 
the complex web of affordances within the lens of the ALM model. Educators 
could explore further how affordances are enacted during game-based language 
learning activities in VLEs based on students’ academic goals, self-efficacy, effort, 
play, and test anxiety. Above all, the five constructs of Robbins et al.’s (2004) 
AML can guide language educators in developing a better understanding on how 
the affordances realised can enhance students’ language learning experiences 
during their participation in epistemic games in VLEs. Future studies need to 
expand further on the complex role of ALC and address them within the situated 
context of epistemic games, as games are gaining more cultural and social value 
and popularity. This is especially beneficial in the case of game-play scenarios in 
VLE in L2 contexts where the game elements can be integrated constructively and 
effectively to promote or enhance further students’ language learning experiences. 
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Abstract. Today’s language classrooms are challenged with limited classroom time 
and lack of input, and output practice in a stress-free environment (Hsu, 2015). 
The use of commercial, readily available tools such as Personal Robots (PRs; e.g. 
Amazon’s Echo, Jibo) might promote language learning by freeing up class time, 
allowing for a more focused personalized instruction, and giving learners more 
opportunities for input exposure and output practice in a stress-free environment. PRs 
are pedagogically valuable because of their built-in Automatic Speech Recognition 
(ASR) software. This feasibility study investigates the pedagogical use of PRs as 
tools to extend the language classroom by combining it with traditional in-class, 
teacher-facilitated interactive practices. We evaluated a commercial PRs’ ability to 
comprehend L2 speech, to provide ‘easy-to-understand’ feedback, and to deliver 
accurate results for a set of pre-established questions. Using a survey and interviews, 
the results highlight the benefits of personalized, computer-mediated instruction as 
an approach to extend the reach of the classroom. As such, our study contributes 
to this under-studied area of Computer-Assisted Language Learning (CALL): the 
pedagogical use of personal robots in L2 education. 

Keywords: ASR, personal assistants, personal robots, L2 learning, L2 speech. 


1. introduction 

The pedagogical use of technologies can be effective in language education as it has 
the potential to enhance the input (in both quality and quantity), provide authentic 
means of communication, and provide learners with personalized and therefore more 
useful feedback. Examples of these technologies include Text to Speech Synthesizers 
(TTSs) and ASR, the two tools utilized in the technology employed in PRs. 
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TTS is a form of speech synthesis that converts text into oral output. It is available 
and embedded in mobile applications for computers and mobile devices such as 
smartphones and tablets. ASR, on the other hand, is a technology that, simply put, 
allows users to speak rather than type in information. As such, ASR transcribes 
speech and provides information based on spoken questions such as “How is the 
weather today in Cyprus'?”. TTS and ASR technologies are seen in products such as 
GPS and voice-controlled personal assistants such as Siri and Cortana. Their goal 
is to recognize intelligible speech with accuracy and efficiency, independent of the 
speaker’s accent, background noise, and other variables. 

Few research that has examined the pedagogical use of TTS and ASR have found 
positive outcomes in language performance and oral self-assessment (Dalby & 
Kewley-Port, 1999; Derwing, Munro, & Carbonaro, 2000). A study by Liakin, 
Cardoso, and Liakina (2015) showed that the use of a more recent commercial 
ASR application had a positive effect on the acquisition of the French vowel /y/. 
Research in mobile technology has shown overall that language students enjoy 
using their mobile devices to learn vocabulary (e.g. Thornton & Houser, 2005) and 
pronunciation (Liakin et al., 2015), and it is beneficial to visual and kinesthetic 
English as a foreign language learners (Hsu, 2015) because it allows them to 
improve their L2 pronunciation through self-regulated learning. 

Interestingly, we are not aware of any study that investigates the pedagogical 
potential of PRs such as Amazon Echo and Jibo in L2 education. To address this 
gap, this study investigates L2 learners’ perceptions of the personal robot Echo as a 
pedagogical tool by addressing the following research question: What are learners’ 
perceptions of using a personal robot (Echo) as a pedagogical tool? In the analysis, 
we considered a number of variables that could affect learners’ perceptions: ease 
of use, options for self-regulation, motivation and, more importantly, opportunities 
for input and output practice. 


2. Method 

2.1. Participants and design 

Four female intermediate-level English learners (equivalent to B1-B2 levels in 
the Common European Framework of Reference for languages) interacted with 
Echo in order to assess its pedagogical usefulness in terms of ease of use, options 
for self-regulation, opportunities for input/output practice, and their motivation to 
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use it. Their interactions, which lasted 30 minutes on average, included asking 
Echo a pre-established set of questions (to find out the tool’s ability to understand 
different phonemes and stress patterns) as well as learner-generated questions. 
Later, participants completed a survey about their perceptions and attitudes towards 
Echo, followed by a semi-structured interview. 

Due to its popularity and low cost, we adopted Amazon Echo (Figure 1), a 23.5 cm 
cylinder speaker that provides oral answers to questions asked and connects to its 
associated app, the cloud-based voice service Alexa. The Alexa app is the actual 
voice recognizer that functions as a companion to Echo for setup, remote control, 
and a set of enhanced features. 

Figure 1. A personal robot: Amazon Echo 



2.2. Procedure 

Participants initially filled out a background questionnaire to report on their 
language learning experience and personal information. They then interacted with 
Echo for approximately 30 minutes using a set of questions and commands (n=26, 
related to general information and games) and learner-generated questions. After 
their interaction, participants were given a 17-item survey using a 5-point Likert 
scale (l=strongly disagree and 5=strongly agree) to quantify their responses to a 
number of statements about their perceptions (e.g. ‘Echo is able to understand me’). 
After the survey, a semi-structured interview was conducted with each participant. 


3. Analysis and results 

For the survey, means and standard deviations were calculated for each item, as 
illustrated in abridged format in Table 1 . 
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Table 1. Survey results: learners’perceptions 


Statements 

MEAN 

SD 

I felt more comfortable speaking English using Echo 
than I would in other types of classroom activities 

3.75 

0.96 

I felt more comfortable speaking English while 
using Echo than I would in front of the teacher 

3.75 

0.96 

I would like to use Echo to learn other languages 

4.25 

1.50 

Echo is a great tool to learn a language 

4.00 

1.15 

Echo is able to understand me 

3.25 

0.50 

Echo’s voice is easy to understand 

4.25 

0.96 

I enjoyed using Echo in this project 

4.75 

0.50 


As indicated in Table 1, participants enjoyed their experience using Echo as a 
pedagogical tool in all of the items included. To summarize the key points, they felt 
comfortable speaking in this type of computer-mediated communication (3.75), 
and consider it a great tool to learn languages (4). In addition, they found that Echo 
was able to comprehend their requests (3.25), was intelligible (4.25), and that their 
experience was overall enjoyable (4.75). 

The transcriptions of the interviews were analyzed and categorized as relating to 
one of the four topics of the research question: ease of use, autonomy, opportunity 
for input and output practice, and motivation. We found that participants considered 
Echo user-friendly, enjoyable, helpful for language learning and fun; as originally 
written: “It’s the first time I talk with the machine, so I found it... c’est amusant [it’s 
fun]”; and “I was very motivated, I want to explore”. Participants also found that Echo 
was helpful for learning pronunciation and vocabulary: “I can hear her to approve 
my English, so I can hear the way she talk and I learn from her the pronunciation”; 
“It increase the understanding of pronunciations and some vocabulary”. Participants 
also expressed that they received good implicit feedback that encouraged repetition: 
“1 think it’s more encouraging, if you have to repeat, it’s like she don’t understand 
you, you can be better the next time”. Our findings also revealed Echo as a helpful 
teacher-facilitated tool to extend the reach of classroom: “I found it very helpful 
maybe in classrooms, to help teachers maybe”. Nevertheless, some participants 
questioned the use of machine-based interactions, and reported problems with the 
speech recognizer that sometimes could not understand their requests. 


4. Discussion and conclusions 

This feasibility study investigated the pedagogical use of a PR (Echo) for L2 
education and its potential to provide speaking opportunities outside the classroom 
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and consequently improve one’s pronunciation skills. Our results corroborate 
previous research in terms of ease of use and assisting in pronunciation practice 
(Liakin et al., 201 5), providing opportunities for input exposure and output practice 
(e.g. Derwing et al., 2000), and motivating students to learn on their own. As such, 
these results can serve as a starting point to a better understanding of this type of 
learning environment, one that is able to cater to different learning styles and that 
can extend the reach of the c lassroom and thus promote self-regulated learning. We 
hope that our study will pave the way for this under-studied area of CALL: the use 
of commercial, readily available personal robots as tools for L2 education. 


References 

Dalby, J., & Kewley-Port, D. (1999). Explicit pronunciation training using automatic speech 
recognition technology. CALICO, 16(3), 425-445. 

Derwing, T. M., Munro, M. J., & Carbonaro, M. (2000). Does popular speech recognition software 
work with ESL speech? TESOL Quarterly, 34(3), 592-603. https://doi.org/10.2307/3587748 

Hsu, L. (2015). An empirical examination of EFL learners’ perceptual learning styles and 
acceptance: SR-based computer-assisted pronunciation training. CALL, 28, 1-20. 

Liakin, D., Cardoso, W., & Liakina, N. (2015). The acquisition of French lyl in a mobile-assisted 
learning environment. CALICO, 32(1), 1-25. 

Thornton, R, & Houser, C. (2005). Using mobile phones in English education in Japan. Journal of 
Computer Assisted Learning, 21, 217-228. https://doi.org/10.lll 1/j. 1365-2729.2005.00129.x 


329 




EUROO 

m 

The Digichaint interactive game 

as a virtual learning environment for Irish 

Neasa Ni Chiarain 1 and Ailbhe Ni Chasaide 2 



Abstract. Although Text-To-Speech (TTS) synthesis has been little used in 
Computer-Assisted Language Learning (CALL), it is ripe for deployment, 
particularly for minority and endangered languages, where learners have little 
access to native speaker models and where few genuinely interactive and engaging 
teaching/leaming materials are available. These considerations lie behind the 
development of Digichaint, an interactive language learning game which uses 
ABAIR Irish TTS voices. It provides a language-rich learning environment for Irish 
language pedagogy and is also used as a testbed to evaluate the intelligibility, quality 
and attractiveness of the ABAIR synthetic voices. 

Keywords: interactive language learning games, text-to-speech synthesis, Irish. 


1. introduction 

This paper describes the development and some of the evaluations carried out of 
a prototype interactive platform for Irish language learning, Digichaint, which 
uses TTS voices developed within the ABAIR initiative (www.abair.ie) at Trinity 
College, Dublin. Digichaint is one of three distinct prototype CALL platforms 
(see Ni Chiarain & Ni Chasaide, 2015, 2016) aligned to current task-based 
language learning/teaching principles, where (incorporating TTS) the spoken 
language is central. Digichaint explores the potential of interactive speech-based 
games for Irish language pedagogy and serves as a testbed for evaluating the 
newly developed TTS voices. 

Digichaint was adapted from The Language Trap (Peirce & Wade, 2010), an 
online casual educational game for teaching German to students preparing for the 
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Irish pre-university examinations, using diphone synthesis. Digichaint used The 
Language Trap graphics and development framework to design a game suited to a 
similar cohort of Irish language learners. 


2. Motivation 

2.1. The Irish language context 

Using synthetic voices in interactive learning games may be far more important 
to the pedagogy of an endangered minority language like Irish, than of a majority 
language. Irish is spoken as a community language only in limited Gaeltacht 
regions in the West of Ireland, but as the country’s first national language, is a 
compulsory subject taught to school leaving age. One major challenge with the 
teaching of Irish is the lack of exposure to native speaker models (most teachers 
are L2 speakers), and there has tended to be an overemphasis on written and 
grammatical competence. 

A further major problem concerns motivation. The dearth of modern pedagogical 
resources makes it difficult to engage the learner. It is clear that the educational 
process is important to the long-term survival of the language - not only in terms 
of its transmission through teaching, but also in fostering engagement with the 
language. The synthesis-based CALL applications being piloted could contribute, 
not only in facilitating more extensive exposure to the spoken language and in 
developing aural/oral skills, but should also help to engage learners, complementing 
current classroom practices. 

2.2. TTS synthetic voices in CALL 

TTS has not been widely used to date in CALL (Gupta & Schulze, 2012). As 
mentioned, the need is not as great in the major languages, given the widespread 
availability of native speaker models. The lack of TTS takeup probably also reflects 
the fact that many systems yield relatively poor quality speech output, particularly 
in terms of prosody, clarity and consistency (Sha, 2010). Evaluations on the use of 
synthetic speech for CALL purposes are scant, pertain to its use in rather restricted 
settings, and do not include the gaming environments considered here. In the 
case of the Irish voices, there has been no formal evaluation to date. Therefore, in 
Digichaint, voices for two main dialects (Connaught and Ulster) are incorporated 
and evaluated for intelligibility, quality and attractiveness 
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3. Structure and principal features of Digichaint 

Digichaint is an interactive guided dialogue that allows students to progress 
through a virtual world of a hotel and its surroundings. The learner selects the 
gender/dialect for their own character - male: Connaught Irish / female: Ulster 
Irish - which were the only choices available in ABAIR at the time. The learner is 
tasked with seeking the missing half of his/her winning Lottery ticket, mistakingly 
discarded, but held by one of eight characters in the hotel. To converse with other 
characters the user selects phrases from a menu of up to four possible options 
shown on the screen and spoken aloud (Figure 1). The goal is not to reveal one’s 
true purpose to avoid being double-crossed. When the holder of the other half of 
the ticket is eventually identified, the learner must negotiate how the winnings are 
to be split. The game can take a great number of pathways as the user controls who 
to speak to at any given point: the choice of conversational turn determines the 
subsequent options (868 utterances were created for the game). A fragment of the 
game’s structure is shown in Figure 2. The game lasts approximately 25 minutes. 

Figure 1. Screenshot from the virtual learning environment Digichaint 



Given only two baseline voices in ABAIR, a major challenge was to provide for the 
extended cast of the game. To differentiate voices, pitch and speed manipulations 
were carried out. Some manipulations rendered the voice somewhat sinister, 
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however. While this did not harm the story’s narrative, it does appear to impact on 
the TTS evaluations (see Results and discussion below). 

As mentioned in Ni Chiarain (2014), 

“[t]he game features linguistic adaptivity[, i.e.] the language level of the 
game adapts to the user’s language level: as the user chooses more complex 
structures, the options on offer become more complex, accordingly. 
Performance feedback and motivational support are provided through 
a particular companion character in the game who, when requested, will 
tell the player that his/her selections are excellent, good, poor, etc. Meta- 
cognitive hints on how well the player is doing appear as thought bubbles 
linked to the main character” (p. 83, emphasis added). 

115 dictionary entries, which give the English translation of particular words and 
phrases, can be accessed by clicking on underlined words in the text. Learners 
receive feedback at the end on their path through the game, their star rating, words/ 
phrases they looked up in the dictionary, etc., and this information is retained for 
future revision. 


Figure 2. Overview visual representation of a section of Digichaint illustrating 
multiple pathways 
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4. Evaluation 

Evaluation of the TTS voices was carried out online by 250 16-17 year old pupils 
(182 female, 68 male) in 13 schools nationwide: these included Gaeltacht (rural), 
Irish-medium (urban), and English-medium schools (both rural and urban). A pre¬ 
game questionnaire elicited background details on individual respondents. Pupils 
then played the game and gave reactions by way of a post-game questionnaire 
(Likert 5-point scale). 


5. Results and discussion 

Pupils’ opinions on the TTS voices were elicited in terms of the five questions 
(Ni Chiarain, 2014) listed in Table 1. Overall, responses to the quality of the 
voices were positive. 70% agreed/agreed completely that the language level was 
right (Ql): as pupils differed widely in proficiency one could expect their level to 
affect intelligibility ratings. Q2 sought to establish specific difficulty with dialect 
variation, and surprisingly low numbers reported difficulty. Intelligibility ratings 
(Q3) were broadly positive: 56% agreed/agreed completely that the voices were 
sufficiently clear to make the speech intelligible (as against 28% disagree/disagree 
completely). Attractiveness ratings (Q4) were rather low, with only 43% rated as 
attractive/very attractive (what might be considered ‘attractive’ was left open). 
As some characters had distorted voice quality the low rating was expected. The 
quality ratings (Q5) are reasonably high at 62%, although the inclusion here too 
of distorted voices has impacted. The ratings for attractiveness and quality, and 
even intelligibility, must be interpreted in conjunction with responses to the other 
two platforms (not covered here) where no voice distortions were included and 
ratings were considerably higher: intelligibility and quality both scored 73% and 
attractiveness scored 57% (Ni Chiarain, 2014). 


Table 1. Questions and results for Digichaint evaluation 


Ql.l The overall standard of the Irish used in this 
game is at about the right level for me 

Completely disagree 

4 

1.6% 

Disagree 

40 

16% 

Neutral 

30 

12% 

Agree 

130 

52% 

Agree completely 

46 

18.4% 

Q1.2 If you feel the Irish used is not at the right level, is this because it was... 

Too difficult 

54 

48.6% 
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6. Conclusions 

Bearing this in mind, there is broadly positive support for the use of the Irish 
TTS voices in such interactive platforms. Note that evaluations of TTS are highly 
specific to the quality of the individual voices and there is great variability across 
systems. Evaluations capture a point in time: even since these tests, the Irish voices 
have been improved and we expect that a similar evaluation would now yield 
higher ratings. Importantly, we now know that the voices are adequate for this 
application and we now have an evaluation method that will serve for testing the 
TTS voices as development continues. 

Furthermore, evaluations of synthesis quality are relative to the context of evaluation. 
When proposing to deploy TTS in CALL platforms, evaluations should be carried 
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out using multiple real-life platforms and real users, rather than relying on laboratory- 
based, decontextualized evaluations, as are the norm in TTS evaluation. 
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learning strategies to transform CALL 

Efi Nisiforou 1 and Antigoni Parmaxi 2 



Abstract. Language researchers have identified a number of elements related to 
language performance. One of these factors is individual attributes of the language 
learners or their cognitive ability. In the fall semester 2015, 18 undergraduates of 
Greek for academic purposes language course of a public university in Cyprus 
participated in the study. This research work attempts to investigate the relationship 
between students’ Field Dependence-Independence (FDI) cognitive ability and 
learning strategies within a Computer-Assisted Language Learning (CALL) 
environment. Students FDI cognitive style was measured on their performance 
on the Hidden Figures Test (HFT) psychometric tool and classified into Field- 
Dependent (FD), Field-Mixed or Neutral (FM/FN), and Field-Independent (FI) 
learners. Statistics and mainly qualitative analyses were used to interpret the data. 
With the end goal of understanding how learners’ FDI cognitive ability intersects in 
learning within a CALL environment, the article concludes with some directions for 
further areas of research. 

Keywords: FDI cognitive abilities, learning strategies, CALL activities, higher 
education. 


1. Introduction 

There are many aspects to be considered when designing and developing learning 
environments - physical or digital. The examination of the relationship between 
individual differences in cognitive styles and learning strategies is one potential 
area of study that can inform the needs of potential users of these environments and 
consequently allow for more personalized materials and environments to be developed. 
Leyu (2001) noted that by taking the cognitive style of language learners’ into account. 
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the instructor could elucidate essential information on learners’ characteristics related 
to the successful learning of a foreign language and consequently relate instructional 
decisions and teaching methods to learners’ individual differences. 

As mentioned by Nisiforou and Laghos (2013), “[FDI] is among the most broadly 
studied of the variety of cognitive style dimensions appearing in the literature 
(Dragon, 2009)” (p. 81). According to Witkin and his colleagues, the FD and FI 
dimensions can respond to the different kinds of learning and teaching methods, 
and they can describe two different ways of processing information (Witkin, 
Moore, Goodenough, & Cox, 1977). Consequently, the FI learner tends to attain 
the best success in classroom language learning, in contrary to the FD individual 
(Chapelle & Heift, 2009). Previous research reported the tendency of FD people 
to adopt a holistic approach to learning, while FIs revoke the information more 
analytically (Tinajero, Castelo, Guisande, & Paramo, 2011). 

This study consists part of an ongoing project which aims to investigate the 
relationship between students’ FDI cognitive ability and learning strategies within 
a CALL environment. Hence, the current work attempts to identify students’ FDI 
cognitive ability and learning strategies on a set of language activities. Therefore, 
the following research question is addressed: what learning strategies do different 
cognitive groups of learners’ exhibit while interacting with a range of language 
learning environments? 


2. Method 

2.1. Participants 

In Fall semester 2015, 18 undergraduates of Greek for academic purposes language 
course of a public university in Cyprus participated in the study during the 13-week 
session of their in-classroom instruction. Four participants were excluded from the 
sample due to non-completion of the HFT psychometric test. The learners’ ages 
range from 19 to 34 years and were recruited from three disciplines; engineering, 
agricultural studies, and multimedia. 

2.2. Research design 

The research design was constructed on the basis of the Task-Based Instruction 
(TBI) methodological approach. TBI uses tasks or stand-alone activities which 
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require comprehending, producing, manipulating or interacting in the target 
language (Nunan, 1999). 

2.3. Materials and procedure 

The research was conducted in two parts on an individual basis and took place in 
the classroom. The HFT was administered before the beginning of the classes. 

2.3.1. Psychometric test 

The participants were initially categorized by their FDI cognitive style (FD, FN, 
and FI) on their performance in the HFT (Ekstrom, French, Harman, & Dermen, 
1976). The HFT is a psychometric tool that measures the level of an individual’s 
field dependency. It consists of 32 questions, and scores ranged from 1 to 32 
(with a maximum of 32 points achievable) on a total completion of 24 minutes. 
The test presents five simple figures and requests learners to find out which of the 
five is embedded - with the same size and orientation - in each of the 32 complex 
patterns (see Figure 1). The testing activity involved in the HFT is a reliable and 
widely-used approach for determining FDI cognitive dimensions. 

Figure 1. HFT task (Ekstrom et ah, 1976) 3 



A B C D E 



3. The task is to identify which one of the five simpler figures is embedded in the more complex figure. The correct response 
is the circled letter ‘A’. 
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2.3.2. Learning activities 

Students were enrolled in a Greek for academic purposes course which aimed at 
enhancing their ability to produce language (both oral and written) at an academic 
level. Throughout this course, students were requested to complete four tasks 
associated with the four skills: 


• Writing: students were tasked to study an academic manuscript and compile 
it in a short text that can be incorporated in their dissertation. 

• Reading comprehension: students were tasked to read an excerpt from an 
academic manuscript and respond to comprehension questions. 

• Speaking: students were tasked to present an academic manuscript related 
to their dissertation. 

• Listening comprehension: students were tasked to listen to an academic 
lecture and summarize its major points of interest. 

Students were requested to elaborate on the process and strategy adopted for 
completing each of the tasks above, resulting in a list of adopted strategies 
employed for completing each task. This list consisted of the dataset for capturing 
students’ learning strategies. 


3. Results 


3.1. Hidden Figures Test 

Participants’ level of field dependency was measured with the use of the HFT 
(Nisiforou & Laghos, 2013, 2015). Individuals who scored 10 or below were 
categorized as FD, those who ranked from 11 to 16 were classified as FN and those 
who achieved a score of 17 or higher as FI. Participants were classified into their 
cognitive group as illustrated in Figure 2. The testing activity involved in the HFT 
is a reliable and widely used approach for determining FDI cognitive dimension. 
Reliability of the internal consistency of the psychometric test has been validated 
using Cronbach’s alpha coefficient, which is a widely-used index of test reliability. 
The closer the score is to +1.00, the higher the reliability. In this research study, the 
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Cronbach’s alpha for the HFT was 0.878 (Cronbach, 1977), indicating that items in 
the psychometric test are correlated to each other. 

Figure 2. Classification and distribution of subjects according to the FD1 
dimension (N=14) 



FD 



FN 


FI 


3.2. Learning activities and strategies 

The dataset that consisted of students’ learning strategies (see section 2.3.2) was 
imported into the NVivo qualitative data analysis software version 11. Students’ 
responses were clustered into codes by virtue of thematic coding. The iterative 
coding approach and the subsequent code saturation elicited a total of 4 main 
thematic topics which were classified under the four given learning tasks. Figure 3 
reflects the thematic categorization of students’ learning strategies. 

Figure 3. Students’ learning strategies followed for listening comprehension. 


reading comprehension, presentation skills and production of written text 
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Table 1 demonstrates participants’ learning strategies employed for the 
accomplishment of the four learning tasks by the cognitive group they belong 
to. Overall, learners’ of all three cognitive groups followed a more holistic 
approach in preference to the analytic approach for the completion of the listening 
comprehension tasks. The common behavior pattern of solving a listening task 
is inconsistent with the literature only with regards to the FD and FN group of 
learners. The results on the FI learners contradict previous studies (e.g. Tinajero 
et al., 2011) and might have occurred because of the small-scale sample size, 
seeing that the preferences of the students who adopted a certain learning approach 
opposed to the other were significantly diverged (only one or two participants). 


Table 1. Learning strategies followed by the learners for the completion of the 
four learning tasks 

Participants FDI Learning Tasks* and Learning Strategy/ Approach** 

Code category 


Listening Reading Production of Presentation 

Comprehension Comprehension Written Text Skills (PS) 

(LC) _ (RC) (PWT) _ 


P3 

P4 

P5 

P9 

P14 

FD 

FD 

FD 

FD 

FD 

AA HA 

✓ 

✓ 

✓ 

V 

V 

AA 

S 

S 

✓ 

HA 

V 

✓ 

AA HA 

✓ 

✓ 

✓ 

✓ 

✓ 

AA HA 

✓ 

✓ 

S 

V 

V 

pi 

FN 

V 


V 

✓ 

S 

P8 

FN 

V 



✓ 

V 

P10 

FN 

s 

S 


V 

✓ 

P12 

FN 

s 


V 

V 

S 

P2 

FI 

s 


s 

S 

S 

P6 

FI 

s 


V 

✓ 

</ 

P7 

FI 

V 

V 


V 

S 

Pll 

FI 

V 

■/ 


✓ 

V 

P13 

FI 

s 



✓ 

V 


Notes: 

* Listening Comprehension (LC), Reading Comprehension (RC) ; Production of Written Text (PWT) ; 
Presentation Skills (PS); ** Analytic approach (AA). Holistic approach (HA) 


As for the reading comprehension task, learners applied their analytical skills by 
extracting detail from its surrounding context. The production of written texts 
exemplified FDs’ and FNs’ holistic mode of thought, whereas, strategies adopted 
by the FNs yielded their ability to analyze info structurally, thus demonstrating 
their analytic way of thinking. Finally, the speaking ability task revealed 
individuals’ presentation skills. Specifically, those who fall between the FD and 
FN cognitive dimension revealed a common learning behavior by choosing the 
analytic pathway, one that identifies the parts of a task and breaks it down into 
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smaller sub-tasks. On the other hand, FIs pursued a holistic mode of thought 
by seeing each task as a whole and not being able to break it down into smaller 
parts. 


4. Discussion and conclusion 

This work has made progress toward the goal of better understanding the link 
between individual differences and use of learning activities within a CALL 
environment. Previous research reported that FD people have a holistic approach 
to learning, while FIs revoke the information more analytically (Tinajero et al., 
2011). The current study found that the capacity to spontaneously shift back and 
forth between analytic and holistic modes of thought differs according to the nature 
of the learning task the learner is engaged with. 

The data provided additional evidence that more work is needed to provide 
instructional design principles for the development of learning environments and 
materials that support different cognitive ability language learners. Awareness of 
cognitive style may be greatly beneficial for teachers and instructional designers, 
as they can inform instructional decisions and teaching methods. Future studies 
of learning strategy usage hold potential for matching learners with appropriate 
instructions and provide a particularly challenging application for this line of 
research. 
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Abstract. In Japan, like most English as a Foreign Language (EFL) contexts, students 
have few opportunities to use English in daily life, and this limits their ability to 
develop their language skills. To address this, many teachers provide homework 
tasks and guide students towards autonomous learning. In an effort to do the latter, 
a private Facebook group was created for students at a women’s university in Tokyo. 
Through the group, the teacher aimed to provide out-of-class opportunities for English 
communication; facilitate access to English-language resources; motivate students to 
study/use English; and create a learning community that had student leaders. This 
article draws on a small-scale questionnaire, participant interviews, and activity within 
the Facebook group to examine the extent to which these goals were achieved. 

Keywords: independent learning, learning community, Facebook. 


1. Introduction 

The Japanese government has described English proficiency as “crucial for 
Japan’s future” (MEXT, 2014, Background to the Reform section, para. 1) 
and implemented numerous strategies to help students develop it. Despite this, 
proficiency is still far from reach for most secondary school students (The Japan 
Times, 2016) and Japanese speakers generally achieve below-average scores 
on proficiency exams (ETS, 2016). At university level, motivation can be low, 
particularly among students who are studying English only because it is required, 
but many students I taught at a women’s university in Tokyo expressed the 
desire to improve their English skills, and some showed a willingness to look 
beyond coursework. Although students can search for learning opportunities 
themselves, teachers can also play an important role in supporting autonomous 
learning (Reinders & Hubbard, 2013; Smith & Craig, 2013). In an attempt to 
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do so, I created a Facebook group for my students. The main aims of the group 
were to provide out-of-class opportunities for English communication, facilitate 
access to English-language resources, motivate students, and create a learning 
community that included student leaders. 


2. Method 

2.1. Managing the Facebook group 

I created a private Facebook group in May 2014 and in the following two years 
invited approximately 400 students from my English classes and a previous 
Facebook project (Ohashi, 2014) to join. Membership was completely voluntary 
and had no bearing on homework or grades. Those who wanted to participate sent 
me a request through the Facebook group, and once approved they could write 
on the group’s ‘wall’, read other members’ posts and comments, and add new 
members. In the first two years, 145 students joined the group. 

2.2. Data collection and analysis 

Data collection took three forms. First, posts and comments were tallied, and posts 
were categorised by type to identify patterns in teacher and student contributions. The 
number of posts each student made were recorded, the search bar was used to check 
if each member had commented, and the ‘seen by’ function was used to check if 
they had read/seen posts. Second, an online questionnaire (N=30) was used to gather 
basic information about participation and motivation. Finally, two students were 
interviewed to obtain more detailed accounts of students’ experiences and views. 


3. Results and discussion 

As outlined above, the Facebook group was created with four aims in mind. These 
are examined one by one in the sections below. 

3.1. Providing opportunities for English communication 

There was strong evidence of students taking the opportunity to communicate in 
English, as shown by their 215 posts and 1000-plus comments. Some of their posts 
and the 186 that I made sparked lengthy threads involving multiple students, with 
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the longest eliciting over 30 comments. However, although 145 students joined 
the group within its first two years, only 69 of them posted. Furthermore, posting 
was not evenly shared by these students, with some posting multiple times (N=37) 
but others posting only once (N—32). 50% of questionnaire respondents did not 
post more frequently (or at all) because they lacked time, 23% were deterred by 
their shyness, and 20% felt under-confident. Confidence was affected by the high 
level of some contributions, with one student noting, “I feel like 1 have to write 
high level, influential posts like [other members] do, so I cannot post much. I feel 
like it’s difficult for me to write motivating posts like that” 2 . While posting was 
challenging, commenting appeared to be less so, with 90 students writing comments. 
The remaining 55 students never wrote anything, but they all participated as 
readers. Questionnaire results (N=30) reflect the patterns shown above, indicating 
that students were more likely to read posts (100%) and read comments (97%) than 
write comments (70%) or write posts (60%). The output (writing) figures suggest 
that the opportunity to communicate was not taken up by some. However, reading 
messages from their teacher and peers was one side of a communicative activity, 
and feedback from the questionnaire showed that 90% of participants read other 
students’ posts ‘often’ or more frequently, with even higher figures for the teacher’s 
posts (97%). Therefore, it can be concluded that all students engaged in at least 
one-way communication, with two-way communication occurring between those 
who chose to interact by reading and writing. 

3.2. Assisting students to access English-language resources 

This aim was met through a combination of my efforts and those of the students. 41 
of my posts had links to educational materials and an additional 26 were provided 
by the learners. Materials shared ranged from video clips and news articles 
to quizzes and book recommendations, with the majority primarily useful for 
developing listening, reading and vocabulary skills. In addition to this, I uploaded 
26 posts about English-language competitions and events, and the students posted 
30 more. These posts provided information about things like speech competitions, 
guest lectures, debates, and lunchtime English chat sessions, with most focusing on 
face-to-face opportunities to listen and speak. 

3.3. Motivating students to study and use English 

In recent years there have been many studies that highlight the complexity of L2 
learner motivation (e.g. Apple, Da Silva, & Fellner, 2013; Domyei & Ushioda, 2013; 
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Ushioda, 2013). In this study, motivation was addressed in a very limited way by 
asking students (in the questionnaire and interviews) if and how the Facebook group 
motivated them. Some students reported being motivated by the efforts of others, 
with one explaining, “[t]his group motivate[s] me because I feel like studying English 
harder and harder when I read posts”. Members did not need to be good at English 
to motivate others, with one student noting, “[s]ome are not good at writing English 
here but they are trying to improv[e] their skills by continuing to write posts. That’s 
impress! ive | and [makes] me feel like studying more”. The group could also push 
students to try when they were unmotivated: “[w]hen I am tired of studying English, 
I read the posts in this group and they encourage me to keep it up” 3 . Furthermore, 
there was evidence to suggest that knowing what others were doing was motivating, 
with one student explaining, “[w]hen I read about other students going overseas I 
want to go too, and that makes me want to use English more” 4 . Although the impact 
the group had on each and every member remains unknown, the questionnaire 
responses, interviews, and comments exchanged within the Facebook group provide 
some evidence of its motivating effects. 

3.4. Creating a learning community with student leaders 

The students in this group took on four different roles, as shown in Figure 1 . Those on 
the fringe were passive, only participating as readers (N=55). Those slightly closer to 
the centre were responsive, reacting to what they read by commenting (N=21). The 
third role, which was more productive, involved not only reading and reacting, but 
also providing posts for others to read (N=56), and those who assumed the fourth role 
were leaders who did all of these things and actively tried to engage others (N=13). 

Figure 1. Roles within the Facebook group 
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I adopted the leader role, posting 186 times, commenting on all of the students’ 
posts, and responding to their comments. In addition, I prompted members to post 
and comment, with 34 of my posts devoted to asking new members to post and/ 
or soliciting contributions from the group. Furthermore, many of my other posts 
included questions. As noted above, 13 leaders emulated my role, and although 
their participation was more limited than mine, they were pro-active members 
who encouraged others in their learning community to participate. When two of 
the leaders were interviewed, they suggested ways to help passive students into 
more active roles. One recommended creating opportunities for students to meet 
face-to-face, as this would make them feel more comfortable writing in the group. 
The other suggested encouraging students to press Tike’ as it shows writers that 
others have read their posts. This student acknowledged the reciprocal relationship 
between readers and writers, noting that “writers motivate the reader, but also the 
reader can motivate the writer to write more” by reacting to them. 


4. Conclusions 

The preliminary findings of this investigation suggest that the private Facebook group 
provided students with opportunities to communicate in English outside of class, 
gave them access to a wide range of English-language resources, and motivated some 
of them to study and use English. In addition, there was evidence that the group had 
evolved into a learning community that was not solely teacher-led, as some students 
had taken on leadership roles. The benefits reported by students make it worthwhile 
to continue hosting the group, and may serve as an incentive for those who are 
considering offering similar opportunities to their students. 
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Abstract. The aim of this paper is to explore if English as a Foreign Language (EFL) 
learners’ usage of an online workbook follows Benford’s law, which predicts the 
frequency of leading digits in numbers describing natural phenomena. According 
to Benford (1938), one can predict the frequency distribution of leading digits in 
numbers describing natural datasets, e.g. river lengths. In such numbers, the digit 
1 occurs most frequently, while the digit 9 occurs least-frequently. This counter¬ 
intuitive phenomenon attracted the attention of researchers seeking inconsistencies 
in data, e.g. false tax claims (Miller, 2015). We show that the practical application of 
Benford’s law could extend to detecting abnormal learner behaviour in online EFL 
products. First, we show that the distributions of leading digits of the number of 
online activities submitted by EFL learners on an e-leaming platform and the time 
spent on those activities do indeed follow Benford’s law. Then, we show that some 
learners whose behaviour does not confonn to Benford’s law show online behaviour 
that is abnormal relative to their peers - in particular, they submit many activities in 
a few days, which could suggest, for example, poor time management. 

Keywords: Benford’s law, EFL, e-learning, time on task. 


1. Introduction 

Benford (1938) stated that it is possible to predict the frequency distribution of 
leading digits in numbers composed of four or more digits describing such natural 
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datasets as river lengths or city populations. In such numbers, the digit 1 is expected 
to be the most frequently occurring leading digit (about 30% of cases), while the 
digit 9 is expected to occur least-frequently (fewer than about 5% of cases), even 
though the chance of occurrence is intuitively expected to be the same for all 
leading digits. In recent years, Benford’s law attracted the attention of researchers 
because of its practical use, e.g. identifying tax or vote frauds (Miller, 2015). 

in education, Benford’s law has been applied to evaluating the chance of picking 
the correct answer among distractors on a multiple-choice test (Slepkov, Ironside, 
& DiBattista, 2015). We know of no previous work exploring the application of 
Benford’s law to e-learning of EFL, hence the present study. 


2. Method 

2.1. Data 

According to Nigrini (2012, pp. 21-22), numbers in a dataset are expected to 
conform to Benford’s law if they describe natural events or facts such as city 
populations (rather than, say, computer-generated bank account numbers) and if 
the dataset has no inherent limit (which excludes, say, exam scores). 

We focused on the number of online learning activities completed by EFL learners 
and the time spent on those activities. The data comes from MyEnglishLab for 
Speakout Pre-intermediate 1st edition (henceforth ‘MyEnglishLab’), an e-learning 
platform with exercises accompanying a textbook. The online activities comprise 
twelve units, each of which contain about thirty activities. The platform is aimed at 
institutions, so most learners analysed here were enrolled in a course set up by their 
teacher or instructor. The anonymised dataset contains 3,218,624 first attempts 
of MyEnglishLab activities from 35,265 learners from 18 different countries 
(speaking 12 different languages). 

2.2. Analysis 

To see if the number of MyEnglishLab activities completed by learners conforms to 
Benford’s law, we counted the total number of activities submitted (i.e. attempted) 
daily by each learner. Days with no learner activity were not included. Resubmitting 
the same activity did not increase the count. For example: if learner A submits 11 
activities on Monday and three activities on Tuesday, and Learner B submits four 
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activities on Tuesday and six on Wednesday, the dataset contains the observations 
{11, 3, 4, 6}. The frequency distribution of the leading digits of these measurements 
was plotted and compared with the expected trend according to Benford’s law. 

To see if time spent on those activities conforms to Benford’s law, we listed the time 
(in seconds) that every learner spent on every first submission of a MyEnglishLab 
activity. Again, the frequency distribution of the leading digits was plotted and 
compared with Benford’s distribution. We ran a Pearson’s Chi-squared Goodness- 
of-Fit test, which is one of several tests used to evaluate if a dataset conforms 
to Benford’s law. Of several such tests available in the BenfordTests R package 
(Version 1.2.0; Joenssen, 2015), this one was the fastest. Data processing and 
visualisation were performed in R (Version 3.2.4; R Core Team, 2016) running in 
RStudio (Version 0.99.893; RStudio, 2016). 


3. Discussion 

A visual inspection of Figure 1 shows that the distribution of leading digits of 
the number of activities submitted daily per learner on MyEnglishLab follows the 
Benford’s law curve closely, with the exception of the digit 1. This means there 
were more cases of learners submitting either one or between 11 and 19 activities 
per day than predicted by Benford’s law. Despite this, it could be stated that the 
number of submitted activities (roughly) conforms to Benford’s law. 

Figure 1. Distribution of leading digits of the number of submitted activities 
compared to Benford’s distribution 



A visual inspection of Figure 2 shows that the distribution of leading digits of time 
spent on single activities submitted on MyEnglishLab also closely follows Benford’s 
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distribution. Although the digit 1 is an exception again, the fit is better. A similar 
result was observed for the first two leading digits of time (not shown in this figure). 


Figure 2. Distribution of leading digits of time spent on MyEnglishLab activities 
compared to Benford’s distribution 



Figure 3 shows learners whose behaviour does not conform to Benford’s law. Each 
thin line represents a learner. Pearson’s Chi-squared Goodness-of-Fit test showed 
that of 12,427 learners who submitted at least 100 MyEnglishLab activities, time 
on task follows Benford’s law for 74% of learners and does not follow Benford’s 
law for 26% of learners (a = 0.05). 

Figure 3. Distribution of leading digits of time spent on MyEnglishLab activities 
by learners whose behaviour does not conform to Benford’s law 
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While exploring backend logs of learner interactions with MyEnglishLab, we 
noticed that some of the 26% of learners whose behaviour does not conform to 
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Benford’s law share three characteristics. First, even if they were enrolled in a 
course that lasted a couple of months, they used the platform to submit exercises 
only for a couple of days. Second, on those few days of activity, the learners 
submitted an unusually high number of activities, often receiving high scores. 
Third, learners seemed to have worked with these activities simultaneously, i.e. they 
opened one activity after another in quick succession (probably in separate browser 
tabs although front-end interactions such as browser focus were not tracked here) 
and then, after some time, quickly submitted one activity after another. This could 
be an indication of cramming. 

Figure 4 shows an example of one such learner. This learner took part in what 
seemed to have been an intensive two-month course, judging by the online activity 
of other participants in that course. While other learners in the course submitted 
activities relatively frequently, this learner submitted 195 activities on three 
different days (within a span of 10 days), scoring -96% per activity, on average. 
On each such day, the learner opened a number of activities almost at once, spent 
more time on each following activity, and then submitted them all almost at once. 
This happened towards the end of the course, so completing online activities might 
have been a course requirement. 

Figure 4. Distribution of leading digits of time spent on MyEnglishLab activities 
by a learner whose behaviour does not conform to Benford’s law 



4. Conclusions 

We showed that the distributions of leading digits of the number of online 
activities completed by EFL learners and the time spent on those activities closely 
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follow Benford’s law. The approach used in this paper shows how insights can be 
revealed in noisy online data, such as the time data, which the standard methods 
of analysis would not reveal. 

Benford’s law has been applied for tax fraud detection and our results show that it 
may also be worth applying it for detection of abnormal learner behaviour. Whereas 
we do not know if the learners whose behaviour did not conform to Benford’s law 
in this particular study behaved so because of poor time management skills or other 
factors, Benford’s law could help flag such learners to teachers who would then 
choose the best course of intervention by talking to learners. 

Still, our findings are directional and future research should focus on validating 
such an approach, and its usefulness to teachers. Another strand of research 
could focus on comparing the computational performance of different tests 
for evaluating conformity to Benford’s law (with operationalising large-scale 
detection in mind) and comparing this approach to other methods of detection 
and prediction of learner performance, e.g. those that rely on simpler metrics, 
such as login frequency. 
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of adopted CALL practices 
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Abstract. As part of a longitudinal study on learner and instructor attitudes and 
patterns of computer and mobile device usage, we have attempted to identify how 
language instructors and students value their use in L2 learning. During the past 
five years at Aoyama Gakuin University (AGU) in Tokyo, we have surveyed both 
students and instructors annually in two separate schools. In the present study, 
results from the surveys administered to both students and instructors within the 
two schools are examined and compared, with a focus exclusively on the survey 
questions corresponding to pedagogically-related issues. Overall, the results show a 
steady movement on the part of instructors away from a more traditional approach 
to teaching English, emphasizing grammar and vocabulary memorization, to a more 
communicative-based approach. Similarly, survey responses from students revealed 
a clear preference for learner-centered classroom instruction over a traditional 
grammar-translation and teacher-centered approach. 

Keywords: motivation, second language learning, L2, MALL, learner attitudes, 
instructor practices, grammar translation. 


1. introduction 

Many Japanese undergraduates lack motivation and are often discouraged with 
their English learning experience, which may be due, in part, to any number of 
factors, including the emphasis placed on traditional exam-centered or grammar- 
based English classrooms at a large number of Japanese universities. This lack of 
motivation and confidence often results in a negative impact on student attitudes 
and classroom behaviors, leading to long-term and widespread negative learning 
outcomes (Pagel & Lambacher, 2014). Teachers can often miscalculate their 


1. College of Science and Engineering, Aoyama Gakuin University, Tokyo, Japan; jwpagel@yahoo.com 

2. School of Social Informatics, Aoyama Gakuin University, Tokyo, Japan; steve.lambacher@gmail.com 

How to cite this article: Pagel, J. W., & Lambacher, S. G. (2016). Implications on pedagogy as a result of adopted CALL 
practices. In S. Papadima-Sophocleous, L. Bradley, & S. Thouesny (Eds), CALL communities and culture — short papers from 
EUROCALL 2016 (pp. 358-362). Research-publishing.net. https://doi.org/10.14705/rpnet.2016.eurocall2016.588 


358 


2016 James W. Pagel and Stephen G. Lambacher (CC BY-NC-ND 4.0) 




Implications on pedagogy as a result of adopted CALL practices 


students’ needs and the targeting of their curriculum, so that it is either too easy 
or too difficult, which also results in negative outcomes on student motivation and 
performance (Dornyei & Ushioda, 2011). 

During the past five years at AGU in Tokyo, we have surveyed both our students and 
instructors annually within two schools - the College of Science and Engineering 
and the School of Social Informatics. A key motivating factor for this research 
has been the total revamping of one of our school’s English curriculum, which 
went into effect in April 2012. The surveys were thus developed to serve as part 
of a faculty development endeavor to evaluate instructor reactions to the new 
curriculum, which required all classes be held in Computer-Assisted Language 
Learning (CALL) classrooms and for instructors to adapt their teaching methods 
to take full advantage of the available facilities and technology. The total number 
of student respondents from both schools has averaged nearly 350 annually. Our 
‘in-house’ teaching faculty has been comprised of nine full-time and 26 part-time 
instructors across the two schools. 

At the past two EUROCALL conferences, we reported on patterns and changes in 
teacher and student attitudes and motivation towards the adoption of CALL/Mobile- 
Assisted Language Learning (MALL) or L2 learning, which is part of an ongoing 
study. The overall results revealed both students and faculty preferred the use of 
MALL and CALL, and found it more motivating and valuable for learning English 
than traditional practices (Pagel & Lambacher, 2014; Pagel, Lambacher, & Reedy, 
2015). In the present study, we focus exclusively on survey questions of the study 
that corresponded to pedagogically-related issues. The main purpose of the study 
is on identifying how students and teachers assess resultant changes to language 
teaching pedagogy. Its primary goal is to better understand the motivation and 
attitudes of English as a Foreign Language (EFL) students consistent with a move 
to more communicative-based classes held in CALL classrooms. 


2. Methods 

The teacher and student surveys consisted of 32 and 47 questions, respectively, 
which involved Likert scale items measured using a six point semantic scale 
reporting agreement with the affective items ranging from one (strongly disagree) 
to six (strongly agree). SurveyMonkey® was used to collect and analyze the survey 
responses. Instructor questions focused on gauging attitudes on a wide range of 
pedagogical issues, including learning theory, student learning styles, and general 
teaching practices. Student questions pertaining to pedagogy were likewise broad, 


359 




James W. Pagel and Stephen G. Lambacher 


and ranged from attitudes and perceptions of learning styles and outcomes, teaching 
methodology and materials, as well as motivation and goals for studying English. 

2.1. Student survey 

The student survey was administered once annually during a five-year period (2012- 
2016). On average, each year a total of approximately 350 students from the two 
schools participated in the study. All participants were native speakers of Japanese 
mostly from the Kanto region, which includes the nearby prefectures of Saitama, 
Chiba, and Kanagawa. These were primarily 1st and 2nd year students ranging 
in age from 19 to 23. The percentages of other demographic variables within this 
population were as follows: female 33%, male 67%; Science and Engineering 
majors 50%, Social Informatics majors 50%; freshmen 46%, sophomores 36%, 
juniors 14%, seniors 4%. 

2.2. Instructor survey 

Following Pagel et al.’s (2015) approach, the instructor survey was administered 
four times during a four-year period (2012-2015). To ensure anonymity, all 
questions regarding personal information, such as age and nationality, were 
eliminated. The number of English instructors of the two faculties currently 
totals 34. While the total number of respondents participating in the study during 
the first three years averaged only 17, this number increased in 2015 due to an 
increase in the number of instructors employed within both faculties as a result 
of an expanded English curriculum. 


3. Results 

Due to space limitations, we present here just a brief sampling of the results from 
both surveys. A higher response rating indicated an increase in agreement and a 
lower rating indicated an increase in disagreement with the survey items. 

3.1. Students 

Student survey responses, in general, revealed relatively low mean ratings for 
questions dealing with traditional classroom practices, such as the grammar- 
translation method and vocabulary memorization (3.45 and 3.19, respectively). 
These residts helped to confirm that students felt it was not being emphasized by 
their instructors in their classrooms. On the other hand, for items that related to 
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perception of the level (3.67), pace (3.69), and understanding (3.77) of classroom 
activities, students exhibited an overall increasing pattern of agreement during the 
five-year period. 

In response to questions related to learning style preferences (i.e. working alone 
vs. working in a group), a majority of students preferred the latter (3.46 vs. 3.63, 
respectively). Also, in response to questions related to extrinsic motivation (e.g. 
relevancy of English for success in job-hunting) a majority of students agreed that 
English was vital for their future (3.84). Conversely, an overall decreasing pattern 
of agreement was observed for the question “studying English only to earn course 
credit for graduation” (3.53), which was encouraging to the authors. 

3.2. Instructors 

The instructor ratings were relatively low for survey questions dealing with 
traditional classroom practices, such as a focus on vocabulary memorization, 
and grammar mastery, and the use of grammar-translation method as a key 
component of classroom instruction. For example, the survey question “the use 
of grammar-translation method as a key component of classroom instruction” 
received a mean rating of 3.25, while the question “1 like to try new things 
to keep the students motivated” received a mean rating of 5.41, which was 
considerably high. In general, the results during the four-year period revealed a 
pattern of steady movement on the part of instructors away from a direction of 
classroom practice emphasizing a more traditional approach to a greater focus on 
communicative-based teaching, with a few exceptions. 


4. Discussion and conclusion 

A majority of Japanese students feel a reluctance to converse in a foreign 
language, which may be due to a number of factors. For English educators 
working as teachers at Japanese universities, it is somewhat rare to find students 
who go out of their way to hone their English skills. Even Japanese students 
who have returned to Japan after living and studying overseas for a number of 
years often feel reluctant to speak out as well, unless they are isolated with other 
fluent speakers of English. We question the reason for this hesitation to learn a 
language and unwillingness to use what students have mastered through their 
language learning experiences. That being said, our students have proved to be 
interested, motivated learners when having encountered a new pedagogy with the 
incorporation of information and communications technology both in and out of 
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the classroom. Likewise, our instructors have shown a willingness to be flexible 
and embrace the new technologies and resultant changes into their teaching 
pedagogies. 

The internal reform incorporating the extensive use of CALL into our school’s 
English curriculum has been the motivating factor behind this research, which has 
attempted to determine whether technology is being embraced in the classroom, 
and beyond (i.e. MALL). However, the curriculum reform has not only affected 
students’ study habits, but also placed a burden on the part of instructors, many 
of whom were unfamiliar with using technology in their instruction and more 
comfortable with traditional lecture style classes focusing on the grammar- 
translation method. We found the instructors’ general movement away from 
a direction of classroom practice emphasizing a more traditional approach to a 
focus on communicative-based teaching, as well as student preferences for it, 
to be extremely positive - and promising. As language educators are exposed 
to new technologies and teaching approaches (e.g. the implementation of CALL 
practices), it is evident that their adaptation is possible, even among traditionally- 
trained native speakers of Japanese serving as EFL teachers. 

We will next turn our attention to a critical yet relatively new area of research 
in language learning and teaching that relates to the adaptation of the Common 
European Framework of Reference for languages (CEFR) in Japan (CEFR-J), with 
the goal of ascertaining to what extent CEFR-J is being understood, adapted, and 
embraced by CALL educators at universities throughout Japan and Asia, and to 
compare it with European practices. 
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Abstract. This article examines the impact of online synchronous tutorials on eight 
second language (L2) practitioners enrolled in a Master of Arts (MA) in Computer- 
Assisted Language Learning (CALL) L2 Curriculum Development and Evaluation 
module. The module is delivered asynchronously and synchronously (lecture). 
To accommodate immediate interaction to the instructor and the students, weekly 
synchronous online tutorials were also included. These tutorials aimed to give the 
opportunity to learners to get their questions answered immediately and receive instant 
feedback, reinforce their understanding of the content covered and the assigned tasks, 
discuss issues of concern, share ideas and knowledge, and interact with the instructor 
for questions or problems. A mixed-method data collection approach was used (records 
of student participation, online interviews in the middle of the course and online 
interviews at the end of the 13-week module). The data analysis indicated a positive 
attitude towards tutorials, improvement in clarity in participants’ understanding of the 
material studied and development of a sense of comfort and reassurance. 

Keywords, e-leaming, online synchronous tutorials, CALL teacher-training. 


1. Introduction 

According to literature, synchronous learning gives the opportunity to participate 
in meaningful face-to-face online interactions (Harris, Mishra, & Koehler, 2009; 
Hrastinski, 2008; Simonson, Smaldino, Albright, & Zvacek, 2012). It allows 
students to ask and teachers to answer questions instantly, and students to interact 
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with fellow students and instructors, rather than learning in isolation (Hrastinski, 
2008). Synchronous e-learning takes place through lectures, discussions, online 
tutorials, etc. It offers different ways of interaction, sharing and collaboration, 
flexibility and personalised learning opportunities (Lorenzo & Ittelson, 2005) in 
real time online (Higley, 2013). However, it requires setting aside a specific time 
slot in participants’ busy schedule in order to be present (Hrastinski, 2008). 

In practice, few instructors incorporate synchronous sessions in their online 
programmes. There are two reasons for this: (1) the large enrolments in online 
programmes reduce the chance of effective online interactions, and (2) instructors 
tend to believe that asynchronous forms of communication such as access to course 
material by simply clicking on course website links are enough as provision of 
communication (Wang & Newlin, 2001). 

Online courses rely primarily on asynchronous communication for course 
information delivery; chat rooms are usually the only synchronous communication. 
This is not organised regularly, because most such courses have large enrolments; 
also, instructors believe it is enough for students to have access to course material 
through links on the course website. Moreover, instructors believe they already 
spend more time preparing web-based than conventional courses. 

In earlier modules of our MA in CALL, it was noted that students needed 
synchronous contact with their instructor, not only during online lectures, but in 
additional synchronous forms, which would support them in their learning, giving 
them opportunities to ask questions and clarify issues on a more individual and 
direct level. Therefore, synchronous tutorials were introduced. 


2. Method 

This exploratory research focusses on the merits of regular scheduled online 
synchronous communication between the instructor and students. We hypothesise 
that such interaction constitutes an important component of the course and enhances 
and clarifies the information accessed in asynchronous ways. 

2.1. Participants 

The intervention of online weekly tutorials was implemented for an online MA in 
CALL 13-week module. Eight students took part with ages ranging from early 20s 
to 50s. Their teaching experience also varied from 20 years to complete novice. 
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2.2. Instrumentation and data analysis procedures 

Three techniques were used to collect data: (1) a 13-week record of students’ 
tutorial participations, (2) end of week 5 online interview questions on synchronous 
learning, and (3) a 23-question (5-point Likert scale) online survey on synchronous 
learning collected at the end of the module in the form of a Google Form survey. 


3. Results 

3.1. Student tutorial participation 

Student weekly tutorial participation was systematically recorded for all 13 weeks. 
Figure 1. Student weekly tutorial participation 

100% 

92% 

84% 

76% 

68 % 

week 1 week 3 week 5 week 7 week 9 week 11 week 13 
week 2 week 4 week 6 Week 8 week 10 week 12 

Student weekly tutorial participation 



According to participation records, most students participated in the tutorials on 
a regular basis: all during ten weeks and six during three weeks. When students 
could not attend during scheduled times, arrangements were made to make up for 
them. This was indication of the value students put to tutorials. 

3.2. End of week 5 online interview 

An online interview was carried out at the end of the week 5 tutorial by the 
instructor. It aimed at finding out how the eight students valued the tutorials after 
five weeks. The study revealed the following. 
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All students found the tutorials beneficial and liked the fact they had the opportunity 
to meet in real time online to ask questions and have points clarified. Three out of 
seven felt motivated by the tutorials and found that they made them keep up to date 
and kept them on their toes. 

Students liked the fact that they were not working in isolation. Five of the seven 
students who had the tutorial with other students liked the fact they had the 
opportunity to exchange ideas with them. Two students said the tutorials suited 
their audio/video learning style. Four students liked having the tutorials on a fixed 
date and time which suited them, particularly halfway through the week; that gave 
them time before the tutorial to go over the material and be ready during tutorials 
to ask questions and go over tasks, and have the rest of the week to complete them. 

3.3. End of module online survey 

Further information regarding student attitudes towards the tutorials was collected 
at the end of the module with the use of a Google Form. These data revealed the 
following. 

Overall, seven students were satisfied with the tutorials. All students felt very 
satisfied and four were satisfied with the tutorials’ value in helping them improve 
their professional effectiveness. Seven students found the tutorials a very 
motivational experience. 

Seven students felt the amount of time dedicated to the tutorials met their needs. 
Regarding the duration of the tutorials, students’ opinion varied from 60, 45, 
30 to 15 minutes. Two students said “as long as needed”. Five students said the 
tutorials should take place once a week, two students said once a fortnight, and 
another said they should take place on demand. Six students said they did not 
find anything they disliked about the tutorials. One said not all tutorials were 
effective; another said they were sometimes too long. Five students said the 
addition of the tutorials helped them in their overall performance enhancement, 
two said very probably and one said probably. All students said they recommend 
the tutorial to future students. 

The conclusions drawn from this survey supported the end of week 5 interview 
results. All students felt the weekly tutorials helped them in the construction of 
their weekly knowledge, skills and experiences in the topics covered each week. 
All the students valued the tutorials. On the whole, students were in favour of 
regular tutorials and felt a sense of comfort and reassurance. 
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4. Discussion and conclusions 

The success of e-learning is associated with effective asynchronous and synchronous 
communication with the materials and the participants. This study examined the 
impact of online synchronous tutorials with eight second language practitioners 
enrolled in an MA in CALL Second Language Curriculum Development and 
Evaluation module. The results suggest that the incorporation of online synchronous 
tutorials gave the opportunity to students to participate in meaningful face-to-face 
real time online learning and interaction, share their understanding of the materials 
studied, both with the instructor and other fellow students, discuss and clarify 
issues, and achieve a better awareness of the topics studied. They were also given 
the opportunity to engage in flexible and personalised learning opportunities, in 
other words to share their learning and not work in isolation. This developed a 
sense of comfort and reassurance, since the module was delivered online. The 
tutorials seemed to give an opportunity to students to reassure themselves in their 
understanding of the concepts covered and the tasks they were required to work 
on. in some way, the tutorials allowed many students to revisit the content of each 
week, to clarify concepts discussed in the lectures or presented in the e-learning 
area, and to clarify what they had to do in terms of tasks. The results support the 
arguments presented in the literature about the benefits of synchronous learning 
(Harris et ah, 2009; Higley, 2013; Hrastinski, 2008; Lorenzo & Ittelson, 2005; 
Simonson et ah, 2012). 

This study has several limitations. The number of participants was only eight 
students. Students in this study chose to do the MA in CALL, knowing that 
participation in this course would require synchronous mode. Students in this 
module may have different abilities and motivation levels than other course 
populations, which may limit the generalisability of this study. 

In conclusion, there are meaningful benefits associated with the inclusion of 
weekly tutorials in e-learning courses. This module tutorial inclusion allowed 
the instructor to perceive the level of awareness of new knowledge of students 
and cater for it during the tutorials and the students to have online face-to-face 
interaction with their instructor and clarify any misconceptions or difficulties they 
had with the module. 
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Abstract. This paper describes micro-teaching delivery in virtual worlds. Emphasis 
is placed on examining the effectiveness of Singularity Viewer, an Internet-based 
Multi-User Virtual Enviromnent (MUVE) as the tool used for assessment of the 
student teacher performance. The overall goal of this endeavour lies in exploiting 
the opportunities derived from such an immersive environment in order to provide 
better distance education. To this end, a total of eight language teacher practitioners 
from different parts of the world took part in this study and engaged in peer¬ 
microteaching as part of their Master of Arts (MA) in Computer Assisted Language 
Learning (CALL) programme. Data acquisition involved screen recordings of the 
peer microteaching sessions, statements in participants’ reflective journals and 
both debriefings and written communication within the virtual world. Our results 
indicated the positive potential of using MUVE platforms as instruments in the 
assessment of student teacher performance. 

Keywords: CALL, teacher education, microteaching, virtual worlds, singularity 
viewer, MUVE. 


1. Introduction 

Recent research reveals that L2 teachers who completed online methodology 
instruction demonstrated less confidence in their abilities to teach L2 learners 
(Kissau & Algozzine, 2015). In spite of efforts to better prepare teachers and provide 
support with emphasis on new technologies, there is a claim that there is need for 
“better professional development opportunities in the CALL area” (Beaven et al., 
2010, p. 7). It is only recently that virtual technology for training in the simulation 
field has been applied in FL/L2 teacher preparation and education programmes 
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(Judge & Katsioloudis, 2011). This paper attempts to shed light on how foreign 
and second language (L2) teaching practices within an MA in CALL online teacher 
education programme can be extended through virtual worlds. Since the virtual 
technology for training in the simulation field has only been recently applied in 
L2 teacher preparation and education programmes (Judge & Katsioloudis, 2011), 
the use of microteaching techniques, supported by the use of Singularity Viewer 
environment, are explored for the development of 3D microteaching, as part of 
the online microteaching component of the programme. Questions regarding the 
effectiveness of Singularity Viewer as a tool for microteaching delivery and the 
extent to which microteaching in virtual worlds raises student teacher awareness of 
the complexity of language teaching through innovative technologies are analysed. 

1.1. Microteaching technique 

Microteaching is frequently conducted as a group activity in teacher-training 
courses. It includes the planning and delivery of a short lesson plan or part of 
the lesson plan amongst peers, followed by feedback both from the trainees and 
the instructor (Richards & Farrell, 2011). It is defined as “a scaled down realistic 
classroom training context in which teachers, both experienced and inexperienced, 
may acquire new teaching skills and refine old ones” (McKnight, 1980, p. 214). 
The benefits of this technique have long been discussed and thus it is often used in 
various teacher preparation programmes. 

Student teachers in this project engaged in 3D peer-microteaching, as part of 
the online microteaching component of the programme. Their teaching was 
screen recorded on a desktop device for formative assessment purposes. Thus, 
their “performance skills, cognitive processes and affective learning” (Wallace, 
1991, p. 98) were determined in order to assess the extent to which participants’ 
technological abilities to create, design and implement a lesson in a new 
technological environment had been developed. 

1.2. Virtual worlds use in teacher education 

According to Meritt, Gibson, Christensen, and Knezek (2013), digital simulations 
“provide low-risk, high-touch, scalable and efficient methods for microteaching 
and pedagogical experimentation combining elements of fantasy and play within 
realistic dynamics and authentic actions into the pre-service classroom” (p. 412). 
Although promising alternative ways to provide a practice environment, it is only 
currently that they have been explored in teacher preparation practice and even less 
in an online training CALL context. Indeed, two alternative MUVE technologies, 
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Second Life and OpenSim were used as the simulation field to prepare teachers on 
how to manage the classroom and anticipate real-life classroom problems in a pre¬ 
defined context (Meritt et al., 2013). The results were rather encouraging in relation 
to the pedagogical knowledge gained. 

1.3. Singularity Viewer as the simulation field 

Singularity Viewer, a client programme for Second Life and OpenSim, is a private 
space owned partly by the Cyprus University of Technology. To this end, only its 
members can have access to the land, i.e. the ten locations, at any given time. As 
a private space, there is more control over what happens and who is present, thus 
diminishing the distractions while enhancing the engagement and attention of the 
participants. In Singularity Viewer, there are some public and private combinations, 
for instance teleporting from one location to the other. This provides access to a 
wider range of environments while permitting the flexible design and deployment of 
a scenario for microteaching according to their needs. A significant limitation is that 
students are allowed to construct and modify a location provided they were primarily 
given the appropriate rights to change some properties of the provided objects. 


2. Method 

2.1. Participants 

Eight practicing language teachers (three males and five females) from different 
parts of the world (Europe and Africa) enrolled in the online MA in CALL 
programme of the Cyprus University of Technology (CUT) participated in this 
study. The participants were part-time and full-time students who had no previous 
experience in creating, designing and delivering microteaching in a Singularity 
Viewer virtual world. Only one of them had previous experience of designing a 
virtual serious game. 

2.2. Procedure 

The use of Singularity Viewer, and its sandbox location in particular, allows users 
to undertake the detailed configuration of their personal teaching place, i.e. the 
tools to be used and the knowledge resources to be provided on the subject of 
interest. Hence, the content can be specifically selected to suit the needs of any 
specific language subject. 
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In this particular study, different locations were implemented, while some students 
preferred to customise their avatars, taking advantage of the tools provided. For 
example, in one of the microteaching instances, they customised their avatars in 
colorful cubes and formed different towers according to their fellow students’ 
instructions in order to learn the colours. The learners thus created connections 
and collaborated with their peers by forming a new virtual learning process. The 
possibility of reusing the entire set of tools and creating a new environment for a 
different subject, simply by changing the resources, demonstrates the richer context 
of the virtual world over any other traditional e-learning platform. 

Teaching sessions lasted 20 minutes: five minutes of preparation and settlement 
in the environment; ten minutes of scenario implementation, predominantly in the 
sandbox area of Singularity Viewer virtual world; and five minutes of debriefing 
at the participants’ (in the form of avatars) home area. In turns, they shared their 
experiences and impressions of the use of virtual worlds and conducted self and 
peer evaluation of their microteaching performance in this environment. After the 
students had finished all their virtual microteaching, reflective journals were used 
to establish the participants’ feelings regarding the whole experience. 

2.3. Data collection 

This study adopted a qualitative approach with a case study design. The virtual 
classroom performance of the participants and their debriefing were screen 
recorded with the use of Atube Catcher, an online free screen recording tool, 
both by the participants and the researcher. Students were instructed to screen 
record the whole procedure in order to evaluate their performance later in their 
reflection journals. Hence, the data were gathered through the observations and 
the participants’ utterances or written communication within the virtual world, 
along with their reflections in their reflective journals. They were further analysed 
qualitatively through a transcribing and coding process (Creswell, 2008). In the 
data analysis process, the emerging themes were categorised. 


3. Results and discussion 

The multi-user virtual worlds were overall considered by the participants as a 
powerful medium for instruction and education as well as a good source of user 
feedback. In addition, analysis of these data provided evidence of students’ integrated 
knowledge of teaching from the perspective of either the actors (as avatars) or the 
audience. According to students’ responses, the easy-to-use affordances of virtual 
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worlds for designing and building enabled them to carry out tasks otherwise 
physically impossible in the real world. For example, students designed and created 
contextualised settings such as a travel agency, a gym, a clothes shop and a disco 
night, where students could simulate the real-life-like roles as avatars in appropriate 
clothes, for specific contextualised purposes, following real-life scenarios. According 
to students’ comments, this enabled them not only to participate in specific 
contextualised situations but also to enjoy interaction with each other. This was also 
observed by the researchers through the screen recorded data. 

Analysis of transcripts of the debriefings and student reflections also revealed 
some common themes that participating student teachers felt teachers should have. 
These include organisation, class management, student engagement, attention to 
positive/negative behaviours, time management, misbehaviour management, and 
proactive teacher behaviours. Some other common themes were related to the 
limited choice of customisation of the avatars and the locations or even the use 
of resources of the private space. 

There were, of course, some limitations in this project that have influenced the validity 
of this study. The relatively small number of the participants - eight overall - was one 
of them. Some technical problems that occurred during the microteaching session, 
such as sound buzzing and echoing were tackled by the participants themselves, while 
some others needed the observers’ further assistance. Indeed, although immediate 
assistance was offered to them, there were some distractions and some annoyance. 


4. Conclusions 

This study focuses on the opportunities Singularity Viewer, a MUVE could offer 
in L2 Teacher Education. The data analysis indicated that the use of virtual world 
desktop applications in microteaching was beneficial for the participants. Student 
teachers explored ways of extending the use of new technologies in their teaching 
beyond the Web 2.0 technologies by actually using the 3D virtual world for teaching 
purposes. Although its limitations need to be addressed, the positive and profitable 
findings of this programme need to be taken into account and further research 
carried out in the use of this technology with a larger number of participants. 
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Abstract. The study draws on the digital technology which allows users to be 
able to learn both linguistic and non-linguistic skills at the same time. Activity 
recognition as well as wireless sensor technology, similar to a Nintendo Wii, is 
embedded or attached to the equipment and ingredients, allowing users to detect 
and evaluate progress as they carry out their cooking tasks in a real world kitchen. 
48 adult participants from 20 countries in total cook, both in a digital kitchen by 
using real objects and in the classroom by looking at typical pictures/photos in the 
textbook. These learners from diverse cultural background pose a great potential 
to the generalizability of the current study. Research questions are: does using real 
objects to cook in the digital kitchen help students learn vocabulary items better 
than looking at photos of the objects in the classroom? If so, to what extent? This 
study attempts to see the effect of physicality in combination with digital technology 
on foreign vocabulary learning by a experimental design. This project not only 
helps address well-known problems in relation to classroom teaching and learning, 
but supports the development of innovative information and communications 
technology for language learning across the world. 

Keywords: CALL, human-computer interaction, task-based learning and teaching, 
vocabulary learning, digital kitchen. 


1. Introduction 

With state-of-the-art technology evolving at an impressive rate, educators in a 
number of countries are keeping up with the times and waking up to global- 
language learning; a good command of English and one or more other languages 
are must-have skills for social and economic, and political purposes (Brecht & 


1. Newcastle University, Newcastle upon Tyne, United Kingdom; j.u.park@ncl.ac.uk 

2. Newcastle University, Newcastle upon Tyne, United Kingdom; paul.seedhouse@ncl.ac.uk 

3. Newcastle University, Newcastle upon Tyne, United Kingdom; robert.comber@ncl.ac.uk 

4. Oxford University, Oxford, United Kingdom; jieun.kiaer@orinst.ox.ac.uk 

How to cite this article: Park, J., Seedhouse, P., Comber, R., & Kiaer, J. (2016). Physicality and language learning. In S. 
Papadima-Sophocleous, L. Bradley & S. Thouesny (Eds), CALL communities and culture — short papers from EUROCALL 
2016 (pp. 375-379). Research-publishing.net. https://doi.org/10.14705/ipnet.2016.eurocall2016.591 


©2016 Jaeuk Park, Paul Seedhouse, Rob Comber, and Jieun Kiaer (CC BY-NC-ND 4.0) 


375 




Jaeuk Park, Paul Seedhouse, Rob Comber, and Jieun Kiaer 


Ingold, 1998). The world-languages other than English include Spanish, French, 
German, Chinese, Japanese and Korean, all of which have more than 50 million 
native speakers, according to the report by Lewis, Gary, and Charles (2016). 
New methods and technologies have opened up incredible opportunities of 
learning these popular languages, giving access to real-connection in real-world 
environments. 

This study used the digital kitchen as a real-world digital learning environment 
(Seedhouse, forthcoming) because the space provides learners with a chance to 
carry out a real world activity: cooking (see Figure 1). The kitchen also provides 
a tangible connection to both what Nattinger (1988) claims as a ‘situational set’ 
of cooking items by which learners can employ physical object for learning 
and to what Skehan (1998) referred to as “real world activities” (p. 95) during 
which learners use authentic language for communicative purposes. Cooking in 
kitchens is an important part of daily life for many, and an activity with a clear 
goal, providing helpful tasks in relation to learning; Trubek and Belliveau (2009) 
suggest that “cooking engages students at an almost instinctive level; the smells, 
sounds, sights, textures and tastes excite senses and intellect” (p. 16). Considering 
the nature of the kitchen and its relevance to learning, it is significant to understand 
the impact of cooking on vocabulary learning in using kitchen environments as 
learning platforms. 


Figure 1. The Korean digital kitchen 



Computer technology has allowed for a wide range of learning platforms for 
language teaching and learning, one of which is Computer-Assisted Language 
Learning (CALL) in combination with Task-Based Learning and Teaching (TBLT) 
(Hinkelman & Gruba, 2012; Salmon, 2011). However, most studies have used 
TBLT principles just to focus on tasks carried out in the classroom to develop 
language skills, and few studies have drawn on the real-world tasks out of the 
classroom, such as asking for directions in the street. Research is therefore needed 
in which learners carry out the real world task of cooking in a digital kitchen to see 
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the difference in learning from when doing tasks in a conventional setting. This is 
the research gap the current study attempts to bridge, using a computer and TBLT 
to examine its effect on vocabulary learning. 


2. Method 

There were 48 adult participants from 20 different countries in Newcastle. A total 
of 24 pairs were chosen to a group. This experimental study was designed to find 
out which environment, a classroom or a digital kitchen is more effective than 
the other in promoting vocabulary gain, and which specific aspect contributes to 
language learning. 

Six pairs (Group A) made the dish using Recipe 1 in the classroom and then 
Recipe 2 in the digital kitchen, while another six pairs (Group D) made Recipe 2 
in the digital kitchen and then Recipe 1 in the classroom. Similarly, Group C 
performed the task using Recipe 2 in the classroom and Recipe 1 in the digital 
kitchen while Group D carried out its tasks, Recipe 2 in the digital kitchen and 
Recipe 1 in the classroom. It is thus possible to compare the four Groups. Two 
recipes have different sets of vocabularies and the same level of difficulty. 

The difference between the two settings is that participants in the kitchen use real 
objects to cook, whereas they simply use photos of objects in the classroom. So, 
the kitchen users could have all five senses, while classroom learners only accessed 
a few senses. In the two different settings, learners went through exactly the same 
test and task procedures in each cooking session; the pre-test assessed ten noun 
vocabulary items; the exercise pre-task required users to collect each item; the 
during-task exercise asked them to manipulate items to cook; the post-task exercise 
requested evaluation; and the post-tests tested their knowledge. Given the nature 
of the classroom, learners did simulate cooking by interacting with a teacher using 
the computer, which was not sensor-based, but they were given the same feedback 
as in the kitchen on their request. 


3. Results 

The mean difference for four tests were higher in a digital kitchen than in a 
classroom and turned out to be statistically significant: immediate receptive test 
MD=1.58,/K.00, immediate productive test MZ)=1.78, p<.00, delayed receptive 
testMZ)=0.83,/?<.04, and delayed productive testMZ)=2.12,/K.OO. Furthermore, 
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in the kitchen, learners used the real objects to the point where they understood 
the form and meaning of a target word, whereas in the classroom, simple images 
of the objects seemed to keep them relatively away from learning. 


4. Discussion 

The statistical analyses showed a clear distinction between the two different 
learning environments. Overall the digital kitchen users scored significantly higher 
than the classroom ones. In both settings, we could observe that learners used not 
only each other, but also a computer as learning resources. However, being able 
to manipulate physical objects in a digital kitchen plays an instrumental role in 
linking linguistic knowledge to their memory. Nattinger (1988) argues that physical 
movements help make memory connections, while in a classroom participants may 
simply rely on their own imagination. The way learners performed the task in the 
digital kitchen demonstrated more interaction in terms of negotiation, repetition, 
information transfer and autonomy between peers, compared to the one in the 
classroom. This might cause different learning outcomes. 

The findings of this study suggest that being able to manipulate real objects in 
the digital kitchen environment can help students obtain vocabulary knowledge. 
In contrast, learners in the classroom simply used photos, which allowed them to 
use a few senses. This might keep them from internalizing the memory, thereby 
resulting in less successful learning. Moreover, being able to manipulate real 
objects using multi-senses was found to aid vocabulary learning, lending support 
to former studies (Nattinger, 1988; Trubek & Belliveau, 2009). Thus, using 
concrete objects provided learners with more vivid and meaningful experiences. 
Our findings show that physicality enriches vocabulary learning. This study 
broadened the research scope of the vocabulary learning in TBLT and CALL by 
using the real world environment of a kitchen. 


5. Conclusions 

The answer to the research question is that learners were able to learn foreign 
vocabulary in the digital kitchen better than in the classroom, because of the 
different levels of physicality and interactional features in the two separate 
settings. Yet, the digital kitchen did not suit all learning styles. Nevertheless, the 
majority of learners preferred the digital kitchen to learn foreign language. Given a 
range of affordances such as self-organizability, motivation, and meaningful tasks 
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in the digital kitchen, it is however not yet clear exactly which factor resulted 
in the contrasting outcome. Therefore, recommended future research would be to 
undertake more controlled experiments. 

The findings of the present study implies not only an additional value in the literature 
of TBLT and CALL, but also a need for potential changes in school curricula and 
practices in second language teaching and learning as this technology will be able 
to complement the main learning activities. 
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Abstract. The advent of Massive Open Online Courses (MOOCs) has dramatically 
changed the way people learn a language. But how can we design an efficient 
language learning environment for a massive number of learners? Are there any 
good practices that showcase successful Massive Open Online Language Course 
(MOOLC) design strategies? According to recent research findings (Perifanou & 
Economides, 2014; Perifanou, 2015) there is not an ideal MOOLC platform that can 
offer a successful massive open online interactive language learning environment. 
Most of the current MOOLCs are following the traditional model of xMOOCs 
that is based on a cognitive behavioral pedagogical model, but there are also few 
examples that embrace the connectivist version, i.e. the cMOOC model (like 
Instreamia, Mixxer, OpenLearning, etc.). This paper aims to facilitate the work 
of language teachers and language and training providers who wish to design and 
create successful massive open online and interactive language courses for all. First, 
it presents the Massive Open Online Interactive Language Learning Environment 
(MOILLE) questionnaire analyzing the key steps in order to design a successful 
LangMOOC 2 . Next, it showcases specific examples of successful LangMOOC 
activities and other platforms’ features. In the end, the paper provides few useful 
and practical tips for the MOOLCs designers. 

Keywords: MOOCs, MOOLCs, foreign language learning, language education. 


1. Introduction 


Nowadays, language competence and intercultural skills are more than ever 
before key qualifications for every citizen in every part of the world. Professional 
development, cultural awareness, mobility facilitation and social skills building 
are only a few of the benefits that language literacy can bring. According to 
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Perifanou, Holotescu, Andone, and Grosseck (2014), “the main barriers to learn a 
language are lack of time and motivation, and [the] expense of language courses” 
(n.p.; see also Andrade et al., 2011). But how easy is it to cover the linguistic 
needs of a big number of people taking under consideration the above language 
learning barriers? For the past few years, open education initiatives, such as 
MOOCs and Open Educational Resources (OERs), have brought about a turning 
point in the field of language learning as they can easily provide free language 
education at a large scale with no time and space limitations. MOOCs could be 
characterized as an innovative educational movement with promising potential 
but it is still in the middle of an ongoing process. Open education initiatives such 
as MOOLCs seem to be a promising solution as they give the opportunity to a 
massive number of learners to learn for free the language of their choice with no 
space and time limitations. 

Research has shown that the key to successful language learning lies in 
interaction, co-creation, community building and networking (Beaven et al.. 
2013; Rubio, 2015). The pedagogical philosophy of MOOLCs is connected 
ideally to the original MOOC, connectivist MOOC (cMOOC), which was built 
on peer-to-peer learning, autonomy, social networking diversity, openness, 
emergent knowledge, and interactivity (Mackness, Mak, & Williams, 2010). 
Research has shown that there is an increasing need for MOOLCs but there 
are no designing formulas for the creation of efficient language courses for 
massive number of learners (Perifanou & Economides, 2014). In the following 
sections this paper aims to propose a questionnaire that can be used as a guide 
by MOOLC developers, designers and teachers who wish either to create or to 
evaluate their own MOOC platforms or courses. A few examples and useful tips 
are also provided. 


2. MOILLE framework and questionnaire 

The MOILLE questionnaire (Table 1) was created based on the MOILLE 
framework in accordance to its six key criteria: (1) content, (2) pedagogy, (3) 
assessment, (4) communication, (5) technical infrastructure, and (6) financial 
issues (Perifanou & Economides, 2014; Perifanou, 2015). The questionnaire can 
guide developers, instructive designers or language teachers who plan to design 
and create an interactive online learning environment for language learners at a 
massive scale. This questionnaire can be also used as an evaluation tool simply 
with the addition of a four-point rating scale (high, medium, low, none degrees) to 
the end of each question or subquestion. 
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Table 1. The MOILLE questionnaire 


CONTENT 

Does the MOOC platform/course: 

Ql. support the use and creation of authentic language resources? 

Q2. allow user generated content and OER integration/production? 

Q3. support textual and highly interactive (multimedia) material? 

Q4. support a variety of activities (individual, group, networked) with clear 
goals that can promote all basic language skills and cultural awareness? 

PEDAGOGY 

Does the MOOC platform/course: 

Ql. support (technically/pedagogically) different types of communication 
(peer-peer, student-teacher, group-group, open community-natives)? 

Q2. promote collaboration and collective intelligence (group projects, forums, etc.)? 

Q3. support autonomous and personalized learning activities (autonomous/ 
self paced/self regulated/personal skills based/reflective learning)? 

Q4. increase motivation and engagement via interesting, playful, interactive 
and often updated activities (playful/game based learning)? 

Q5. provide teachers’ support during the learning process (number of teachers)? 

ASSESSMENT 

Does the MOOC platform/course: 

Ql. support multiple levels of assessment (peer-peer, student-teacher, open, 
automated) during the whole learning process (pre/ongoing/final assessment)? 

Q2. support ‘open’ ongoing assessment actions such as comments, reviews, ‘likes’, 
shares in social media, or an award automated system for badges and karma? 

Q3. support visualization of the learning progress (evidence- 
based improvement with data mining, learning analytics)? 

COMMUNICATION 

Does the MOOC platform/course: 

Ql. offer social community building features (social media, forums, 
my personal network, third party tool integration and other tech 
tools, etc.) that can ensure massiveness and openness? 

Q2. promote communication with native speakers? 

TECHNICAL INFRASTRUCTURE 

Does the MOOC platform/course: 

Ql. provide tech infrastructure for asynchronous (private messaging, email, 
etc.) and synchronous (chat, video conference, etc.) communication? 

Q2. support technically OER integration/production? 

Q3. support interoperability with other devices (tablet, mobile)? and social 
media/social network integration (blog, wiki, Facebook, etc.)? 

Q4. have a good technical performance with a massive number of participants? 

Q5. provide a high security system in many levels (identification system, 
clear copyright and intellectual property ownership and usage, payment 
system for concrete services such as certification, ECTS, etc.)? 

Q6. offer good usability/personal dashboard (bookmarking, notes, 
friends, messages, my SM, my content, my grades, etc.)? 
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Q7. support technologically a multi-level assessment/award system (peer- 
peer, automated self evaluation, badges, karma, learning analytics, etc.)? 
FINANCIAL ISSUES 
Does the MOOC platform/course: 

Ql. have low costs for its development, implementation and maintenance? 
Q2. support certification/accreditation solutions or extra services at low cost? 
Q3. potentially have chances to lead to a successful business plan? 


3. MOOLC practices: successful examples, useful tips 

3.1. Examples of successful LangMOOC activities 
and interesting features of MOOLC platforms 


MOOLC instructional designers should explore successful MOOLC activities that 
could inspire them to create their own courses. For example: 

• Thematic chats or face-to-face instant communication among language 
peers and teachers using Google Hangouts in groups of ten maximum: the 
activity should have a predefined topic, time and type of communication 
such as a self-presentation activity using text, live video or audio. This 
can be used in combination with general discussion forums. News feeds 
and an email notification system on all important class activities are also 
proposed just like in a social network in order to personalize the learning 
schedule (EdX MOOC platform, Instreamia). 

• Authentic oral communication with native speakers via the free voice over 
IP phone program Skype (Mixxer platform). 

• Creation and use of OER’s rich content (Eliademy platform). 

Interesting features of MOOC platforms that may facilitate the language learning 
process are the following: 

• Personal study calendar where each student can find all assigned courses, 
quizzes and deadlines (Eliademy), visualization of daily learning progress 
based on different language skills and progress report that presents all 
activities and rates (Instreamia). 
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• Gamification of the learning process and assessment: the learner earns a 
variety of badges for every completed task, participation, peers’ support, 
etc. (UNED coma). 

• Interoperability of the MOOLC platfonn with other devices. 

• Strong community features: social media, third party tool integration, etc. 

3.2. Useful tips for MOOLC designers 

A promising MOOLC platform should promote a cMOOCs’ pedagogy via a variety 
of tech functionalities that can support collaboration, communication, and authentic 
and autonomous learning (Perifanou & Economides, 2014). It is though highly 
recommended that language teachers as well as private educational institutions 
collaborate with instructional designers and developers in order to find the most 
adequate MOOC platform for their needs. Another important issue that needs to 
be considered is the choice of a platform which can offer a multiple and open 
assessment tools’ system (computer-based assessment, teacher-based assessment, 
automated peer-peer assessment engine, automated award system) that facilitates a 
multi-level assessment peer-peer, student-teacher, group-group, and student-‘open 
communities’ during the whole learning progress. 


4. Conclusions 

Designing an efficient language learning environment for a massive number of 
learners is not an easy task. It needs a joint effort of instructive designers, developers 
and language teachers who will design, implement and evaluate different MOOLC 
scenarios in order to achieve this goal. Sharing good ideas, practices and examples 
of these initiatives is a starting point. This paper envisages to start an open 
discussion about MOOLCs design proposing the MOILLE questionnaire and 
showcasing good practices. 
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Abstract. In the age of globalization, the need for language learning is greater than 
ever before. “Globalization is a process by which the people of the world are unified 
into a single society and [function] together” (Chomsky, 2006, cited in Ivan, 2012, 
p. 81). As global citizens we need to be able to work in settings characterized by 
linguistic and cultural diversity and that means that “language competencies and 
intercultural skills [are] more than ever a part of the key qualifications needed to 
successfully work and live in this new reality” (Perifanou & Economides, 2014, 
p. 3561). Even though many prestigious universities offer open language courses 
at a large scale, choosing well known Massive Open Online Course (MOOC) 
providers, the body of research on mapping existing language learning MOOC 
initiatives worldwide is rather poor. This paper aims to partially fill this research 
gap presenting the research contribution of the Erasmus+ KA2 project entitled 
LangMOOC project. More specifically, the paper first presents the main findings of 
the background research (Perifanou, 2014; Perifanou & Economides, 2014) of the 
LangMOOC project that has explored the first language learning MOOC initiatives 
and evaluated them based on the Massive Open Online Interactive Language 
Learning Environment (MOILLE 2 ) framework. Next, the paper analyzes the overall 
aims of the LangMOOC project and in the end, it discusses its first research findings 
as well as its future research steps. 

Keywords: MOOLCs, Foreign Language Learning, OER. 


1. introduction 

In the age of globalization, open access to language courses and resources is needed 
more than ever before in order to meet the needs of linguistically and culturally 
diverse learners who live and work in a global society. Nowadays, the levels of 
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multilingualism and multiculturalism have increased. The challenge of offering 
free language education worldwide and at a large scale is huge. Massive Open 
Online Language Courses (MOOLCs) is a recent educational phenomenon ofonline 
learning that can promote linguistic diversity and language learning, breaking all 
linguistic barriers (Colas, Sloep, & Garreta-Domingo, 2016). In fact, in the last 
four years there is a really growing interest for MOOCs and Open Educational 
Resources (OERs) connected to foreign language learning. For example, over 
370,000 students have enrolled in the #|FLEnglishIELTS course that prepared them 
for the English language proficiency test IELTS 3 . This course was offered by the 
FutureLearn MOOC provider, making it the biggest MOOC so far in the world 
(Coughlan, 2015). 

The first attempt not only to map but also to evaluate the situation of MOOLCs 
worldwide was made in 2014 (Perifanou & Economides, 2014). More concretely, the 
researchers proposed the MOILLE framework in order to evaluate all the MOOLCs 
initiatives offered up to 2014. This framework - also discussed in Perifanou, 
2016, this volume - proposes six basic criteria (i.e content, pedagogy, assessment, 
community, technical infrastructure, and financial issues) that need to be taken under 
consideration for the successful design and creation of an efficient interactive open 
and online language learning environment for a massive number of learners. 

The MOILLE framework generally embraces a constructivist way of language 
learning and proposes a “highly interactive [learning] environment where the 
learners are interconnected to a language learning community building collectively 
their language skills” (Perifanou & Economides, 2014, p. 3568). The main research 
aim was to identify if there were MOOLC initiatives that could provide a promising 
MOILLE. According to the research findings the answer was ‘no’ because of the 
following main reasons. Since the beginning of MOOCs up to 2014 there were “more 
than 16 MOOC platforms that [have offered] more than 50 free [online] language 
learning courses. More than a half of them were English language MOOCs but 
there [was] also a great interest for other languages like Arabic, Spanish, Japanese, 
Chinese, etc.” (Perifanou. 2015a, p. 6). Another important research finding was 
that even though there were some good MOOLC examples, like SpanishMOOC 
and Mixxer MOOC, most of the evaluated MOOLC initiatives have adopted the 
traditional model of MOOCs based on a cognitive behavioral pedagogical model 
(xMOOCs) and did not embrace a more constructivist type (cMOOCs) (for futher 
reading on a behavioural as opposed to constructivist approach in MOOLCS, see 
Perifanou & Economides, 2014). 


3. International English Language Testing System 
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One of the basic aims of the EU funded project LangMOOC 4 was to repeat the 
same research methodology with few changes, such as to identify open source and 
free MOOC platforms, in order to map and evaluate the state of MOOLCs during 
2015 but also to compare the latest research results to those of 2014. 


2. Research methodology 

2.1. LangMOOC basic research steps 

The LangMOOC project has adopted the same research methodology adopted by 
previous research (Perifanou & Economides, 2014; Perifanou, 2014) following 
4 concrete research steps: 

• First stage: exploration of all the MOOLCs aiming at identifying all 
MOOC platforms available during 2015 with the support of concrete 
research tools such as MOOC aggregators, MOOC portals, etc. 

• Second stage: classification of the MOOLC initiatives/platforms with 
respect to the following criteria: (1) use of open source platform/possibility 
to create a language course individually (i.e. as a teacher), (2) free access to 
massive online language courses, (3) pedagogy, (4) type of accreditation, 
and (5) variety of languages and number of courses. 

• Third stage: evaluation of six representative MOOLC platforms based on 
the MOILLE framework. 

• Fourth stage: analysis of the research findings and useful conclusions 
(Perifanou, 2015b). 

2.2. LangMOOC implementation 

Based on the research findings, the LangMOOC research team aims to propose 
an improved MOOLC solution that could be implemented by non-academic 
institutions such as private language schools, language teachers and trainers. In 
order to achieve this goal the LangMOOC project team has created a toolkit, a step- 
by-step guideline which includes all the innovative methods and technical tools 


4. https://www.langmooc.com/ 
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for the creation, management and evaluation of MOOCs and OERs for language 
learning addressed to non-academic institutions. The LangMOOC project team has 
also run a series of pilot MOOLCs in order to test the use of OERs in language 
MOOCs as well as the efficiency of the toolkit promoting at the same time the 
learning of less ‘popular’ used European languages (e.g. Greek, Norwegian and 
Italian). 


3. Main results and discussion 

We found 67 different MOOC platforms/providers in total and 29 of those have 
already offered MOOLCs of 20+ different languages during 2015. Most of them 
(21 out of 29) were courses for English but there was a big interest for other 
languages too such as Spanish and Chinese/Mandarin (12 out of 29) but also for 
less spoken languages such as Greek, Swedish and Irish (1 out of 29). Compared 
to the research results of 2014, there is an increase of MOOLC initiatives from 16 
to 29. Another interesting research finding is that there are 18 out of 29 MOOC 
platforms (e.g. Open EdX, Moodle, OpenMOOC, WeMOOC, OpenLearning) 
which use free and open source software. Many of those also give the opportunity 
to language organizations or to language teachers to build their own MOOLCs 
(with the possibility to add payment for their services). Almost all of the MOOLCs 
(24 out of 29) offer accreditation (certifications, badges and/or ECTS credits) after 
the completion of 70% or 80% of the language course in most cases. Regarding 
the pedagogy adopted, there are few examples (3 out of 29), such as Mixxer, 
Instreamia, OpenLearning and TandemMOOC, which support a connectivist 
way of learning, emphasizing the role of social and cultural context. The residts 
show that the MOOLCs’ pedagogy has remained almost the same compared to the 
one of 2014 despite the total number increase of MOOLCs’ initiatives. The third 
stage of the research evaluating six representative MOOLC platforms (i.e open. 
EdX, OpenLearning, Instreamia, The Mixxer, UNED, and Eliademy) based on the 
MOILLE framework have shown another important research finding: there is not 
one ideal MOOLC platform that can offer a successful MOILLE but there are a 
few successful cases. In general, most of the evaluated MOOLCs are following the 
traditional model ofxMOOCs (Perifanou, 2015b). 


4. Conclusions 

One of the LangMOOC’s main goals was to map and evaluate the MOOLCs at a 
global level. The results described in the previous paragraphs have shown that even 
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though there is an increasing interest for MOOLCs worldwide, the need for the 
design and creation of successful MOOLCs is high because most of the evaluated 
MOOLCs still do not offer a successful MOILLE. Furthermore, issues such as the 
language teachers’ new role, time and implementation costs, the empowerment 
of authentic communication with native speakers, multi-level assessment and 
accreditation, and MOOC platforms’ interoperability remain important and should 
be considered carefully by all MOOLC teachers/designers. 

The LangMOOC project team envisages that the toolkit will facilitate the work of 
language teachers and language and training institutions across Europe who wish 
to design and create successful MOOCs. 
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Abstract. In language learning today, students from different geographical locations 
are able to interact online in a more authentic environment, share their views 
with their partners, create profiles as well as build online communities enjoying 
common interests. With this in mind, this paper examines and reports on a study 
about how students from two different countries, Finland and Spain, developed 
intercultural competence through the use of a videoconferencing platform, Adobe 
Connect, as a telecollaborative learning context. Eleven Spanish and seventeen 
Finnish participants were provided with the opportunity to interact with each other 
outside the classroom with a view to exploring the target culture and, consequently, 
experiencing intercultural learning. The findings suggest that the students’ learning 
experience was positive and to some extent they had enhanced their knowledge of 
each other’s cultural traits, such as their lifestyle, hobbies and traditions. 

Keywords: telecollaboration, videoconferencing, intercultural competence, cross- 
cultural interaction. 


1. Introduction 

In language learning today, students from different geographical locations 
can interact online with a view to developing language skills and intercultural 
competence. This online intercultural exchange, which is also known as 
telecollaboration, enables students to interact outside the classroom situation, 
exchange their opinions with their peers, give a description of themselves 
and create online groups who do similar activities. Consequently, Computer- 
Mediated Communication (CMC) is being increasingly used by language 
teachers since students can communicate both synchronously and asynchronously 
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through a computer with their counterparts in other countries as well as native 
speakers. With regard to synchronous CMC, chat sessions have been found to 
be effective communicative tools at intercultural levels (Chun, 2011; Tudini, 
2007). Furthermore, research studies, conducted by means of videoconferencing 
involving sophisticated audiovisual web communication platforms, such as 
Adobe Connect, Elluminate or Visu (Canto, Jauregi, & Van Den Bergh, 2013; 
Guichon, 2010; Jauregi & Banados, 2010), describe experiences contributing to 
communicative or intercultural development. However, there exists no strong 
empirical evidence to support the latter and the target of the present study is 
to make a contribution in this area. Hence, the study aims, firstly, to analyse 
the development of intercultural competence between students of two different 
countries, namely Spain and Finland, during their interaction via videoconference 
on the Adobe Connect platform; and, secondly, to discuss the participants’ most 
important learning outcome of the project. The two research questions that 
guided the study are as follows: 

• To what extent is intercultural competence developed in students’ 
interaction via videoconferencing? 

• What do the participants consider to be the most important learning 
outcome in this intercultural project? 


2. Method 

2.1. The project 

The project designed for the present study was task-based and lasted for six weeks. 
The 11 Spanish participants were preparing for their Cambridge English Cl and 
C2 levels (based on the Common European Framework of Reference) at a private 
language school in Spain, whilst the 17 Finnish participants were studying Spanish 
at a university in Finland. The participants were expected to interact synchronously 
via videoconferencing on the Adobe Connect platform and the links to the online 
interactions were then posted on Facebook (an additional tool used) so that they 
could watch each other’s video sessions. Six specific tasks were assigned on a 
weekly basis. The tasks comprised introducing themselves, talking about leisure 
activities/sports that are popular at their respective institutions, discussing a 
newspaper article relating to an important issue in their country, debating a film 
that they had watched and, finally, exploring stereotyped ideas pertaining to each 
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country. Each student recorded their introductory task on video via Movenote, 
which they posted on Facebook for their peers to watch. 

2.2. Data collection and analysis 

The study adopted a qualitative and quantitative approach and data were collected 
from various sources, namely videos via Movenote and Adobe Connect. Following 
Vurdien’s (2014) approach, two questionnaires were administered at the beginning 
and end of the project, and interviews were conducted individually on its conclusion. 
Finally, a survey in the form of a questionnaire consisting of eight statements was 
completed by the participants to gather additional data. A five-point Likert scale 
ranging from one (strongly disagree) to five (strongly agree) was used to gauge the 
students’ reactions to the project. 


3. Results and discussion 

The majority of the students had a favourable overview of their experience 
(Table 1). The survey shows that the students responded positively when asked if 
they were curious to learn about their peers’ culture (statement 2, mean 4.25) and if 
they felt motivated to interact with their peers online (statement 3, mean 3.68). In 
general, there were no major differences between the Spanish and Finnish students, 
although the Finnish students were a little bit more critical in their feedback and 
assessment. This could be attributed to the fact that most Finnish students had 
already had experience of the Spanish customs and habits on their frequent visits 
to Spain and through contact with their Spanish friends. As they also explained 
in their interview, they felt uneasy while communicating with their Spanish peers 
due to their speaking level being only Bl, and consequently, had some difficulties 
in expressing their views. Nonetheless, the students found the task and the issues 
discussed in general interesting (statement 4, mean 3.64). 


Table 1. Students’appraisal of their learning experience 


Statement 

Mean 

Median 

Standard 

Deviation 

1.1 enjoyed exchanging views with 
my peers via video conferencing. 

4.04 

4 

0.64 

2.1 was curious to leam about my peers’ culture. 

4.25 

4 

0.70 

3.1 felt motivated to interact with my peers online. 

3.68 

3.5 

0.86 

4.1 found the issues we discussed interesting. 

3.64 

4 

0.78 

5.1 enjoyed working in groups. 

3.93 

4 

0.83 
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6.1 felt happy to share knowledge with my peers. 

4.04 

4 

0.64 

7.1 have a better understanding of 
my peers’ customs and habits. 

3.68 

4 

0.90 

8.1 found my peers’ comments to be 
very helpful and informative. 

3.68 

4 

0.90 


In their interviews, the students perceived certain similarities and differences 
between their cultural traits through their willingness to learn about each other’s 
customs and habits, and share knowledge with each other. They mentioned 
differences in customs, such as Spain being a more family-centred country, whilst 
in Finland people tend to adopt a more independent attitude. Another difference 
mentioned is that many Spanish university students live with their parents, whereas 
the Finnish students generally live by themselves. Nevertheless, many students 
reported that there were surprisingly many similarities in customs, values and 
hobbies as well as in lifestyles and thoughts. As for the outcome of their learning 
experience, the Finnish students claimed that, due to the short duration of the 
project, the issues were not explored deeply enough to understand each other’s 
cultural traits fully. Some Spaniards, on the other hand, were satisfied with their 
online interaction and believed that they had enhanced their knowledge about some 
Finnish cultural traits due to immediate explanation and clarification being given 
during their online engagement. In some participants’ view, videoconferencing can 
assist in developing friendship since they can see each other, and body language 
facilitates interaction. A genuine interest in each other’s culture plays a crucial role 
in building friendship, as mentioned by others. Flowever, a few reported that online 
relationships seem too distant compared with face-to-face interactions which tend 
to foster friendship better. 

The students’ appraisal of the issues they discussed exhibited the lowest mean 
(3.64). This could be explained by the fact that, although they were generally 
interested in exchanging views on the different subjects they debated, they found 
the task regarding watching the film and talking about it quite insignificant. The 
students did not all watch the same films and, as a result, could not follow the 
thread of discussion. Therefore it would be vital for teachers to select the film they 
consider appropriate for such a task. 

Judging from the students’ responses in their questionnaires, videoconferencing 
can be deemed a useful tool for meaningful learning to take place. Students can 
feel stimulated to develop curiosity to learn about each other’s lifestyle and, as a 
result, can develop intercultural learning. Because of the synchronous nature of 
videoconferencing, students are able to spontaneously exchange information and 
clarify any misunderstanding without any delayed response, thereby facilitating 
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their understanding of each other’s cultural traits. Yet the findings from the 
interviews suggest that the time factor plays a role in exploring issues leading to 
intercultural development. Therefore, the length of the study should be taken into 
consideration, as intercultural learning is a long term process and students need 
time to reflect on their own views prior to reflecting on those of their peers. With 
regard to developing relationships online, it might surmise that tasks should be 
carefully chosen and geared towards that aim to benefit students. For example, 
activities related to students’ interests in terms of their age group and their area of 
studies might be useful for this purpose. 


4. Conclusion 

This study has given some insight into how videoconferencing can foster 
intercultural learning by means of tasks that aided students to discover information 
about each other’s cultural traits. The main aim was to examine how intercultural 
competence is developed in students’ interaction via videoconferencing and what 
the students considered to be the most important learning outcome. Surprisingly, 
similarities concerning customs, habits, hobbies and even lifestyle were noted. 
In tenns of their learning outcome, some students thought that they did not have 
sufficient time to explore the issues deeply enough since the project was of a short 
duration. However, others believed that they had enhanced their knowledge of their 
counterparts’ culture. Videoconferencing seems to be an appropriate tool to assist 
students in discussing and sharing their thoughts with a view to understanding 
each other’s culture as well as developing friendship. Yet sufficient time should 
be provided for students to attain this goal since it is an on-going learning process. 
However, due to the small scale of this study, the data cannot be generalised and, 
hopefully, further research in this area will benefit the learning process. 
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Abstract. This study introduces the digital game Pret a negocier, an information 
gap digital game, and investigates language learners’ perceptions of its use in a 
French as a Second Language (FSL) context. In the game, students negotiate orally 
and synchronously with a partner for items like cars, houses, and even pirate ships. 
Inspired by Larsen-Freeman and Long’s (1991) information gap activity, game 
players exchange information to solve a common problem (e.g. to buy a car within 
certain conditions imposed by the game). As a competitive game, the pairs must use 
their oral interaction skills in a comprehensible and persuasive manner to win (e.g. 
to obtain the best final price on a product). In addition to describing Pret a negocier, 
this study examines 28 students’ perceptions of its pedagogical use in a standard 
FSL classroom via a triangulation of methods that include a survey, interviews with 
participants, and focus group discussions. Based on our findings, we conclude that 
students’ perceptions of the game are highly positive in most aspects of our analysis 
and that Pret a negocier is well-positioned to help students improve oral interaction 
skills in a fun, comfortable, and interactive manner. 

Keywords: computer-assisted language learning, mobile technology, digital 
gaming, L2 education, learner perceptions. 


1. introduction 


Oral interaction is a second language (L2) competency that is required in everyday 
tasks like talking on the phone with a colleague or having a face-to-face conference 
with a teacher (Hall, 2003). Developing oral interaction skills has many benefits for 
second language acquisition as students not only practice listening and speaking, but 
also become motivated to give feedback on what the interlocutor is saying (Gass, 1997). 
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Information gap activities develop interaction skills by requiring learners to engage 
in dialogue with one another in order to exchange partial information sets so that 
the team can solve problems that require knowledge of the entire information set. 
Through the ‘forced output’ generated by these types of activities, learners become 
aware of and fill in gaps in their L2 linguistic knowledge through negotiation with 
their interlocutors (Swain & Lapkin, 1995). However, oral interaction frequently 
goes underdeveloped in language classrooms. A recent study by Zuniga and Simard 
(2016), for example, reported that out of 64 hours of classroom observation, Quebec 
high school language teachers spent 8% of the time developing these interactive skills. 

The current study introduces and examines the game Pret a negocier as a digital 
information gap activity whose aim is to help students develop oral interaction 
skills. Developed by Rueb, Cardoso and Affordance Studio 4 , the game can be 
played on mobile devices, desktops and laptops, both in the classroom through 
face-to-face conversations or at home through an audio chat solution. In the game, 
students earn points for achieving two objectives: exchanging information about 
the product and arriving at a final price (see Figure 1). Specifically, the product 
information must be exchanged in terms of the players’ roles criteria (i.e. what the 
buyer is looking for and what the seller is offering). After the item infonnation has 
been exchanged, students must continue talking to agree on a final price below the 
maximum price of the buyer and above the minimum price of the seller. 

Figure 1. Pret a negocier interface (buyer’s view) 



4. Visit http://app.readytonegotiate.com for a demo version of the game and email avery@affordancestudio.com for a free 
teacher trial account 
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We believe that Pret a negocier has the potential to help students develop oral 
interaction skills in a fun, engaging and immersive environment, not only in the 
classroom under the teacher’s supervision, but also outside of the classroom on the 
learner’s own schedule. The goal of our study is to examine students’ perceptions 
of and attitudes toward Pret a negocier via the use of a survey, interviews, and 
focus group sections, as will be discussed below. 


2. Method 

2.1. Participants 

The participants were 28 post-secondary students enrolled in an intermediate-level 
FSL class in a post-secondary institution (a cegep ) in Quebec, Canada. The goal of 
the course was to develop writing, listening, reading and speaking skills to prepare 
students for credit classes at the post-secondary level. The participants had various 
native languages including Vietnamese, Spanish, Chinese, Arabic and English, and 
their average age was approximately 20 (range 17-25). 

2.2. Design and procedure 

Participants met with the classroom teacher two-times a week for 100 minutes 
each class. The treatment consisted of game-playing during 25-minute sessions, 
twice a week, over a four-week period for a total of approximately 200 minutes of 
game play. The study was completed using an early version of the Pret a negocier 
game with four different negotiation scenarios: buying a car, renting an apartment, 
buying a pirate ship, and purchasing a trip to space. 

After the last treatment session, participants completed the survey and participated 
in interviews. Select participants also gave feedback in a focus group. The survey 
contained 16 statements using a 6-point Likert scale ranging from strongly 
disagree (1) to strongly agree (6) with numerical values indicating degrees of 
agreement, and asked questions about how the game contributed to learning 
(e.g. “Pret a negocier helped me improve my vocabulary”). The research team 
also conducted interviews and a focus group session with participants in order 
to delve deeper into some of their answers and to expand on their understanding 
of the tool’s usefulness. In this study, we report the results from the analysis of 
the data collected from the survey, focus group, and individual interviews with 
the participants. 
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3. Results and discussion 

Based on the descriptive statistics from the survey as well as the analysis of the 
interview and focus group transcripts, our results indicate that participants found 
Pret a negocier to be enjoyable and helpful for language learning. Due to space 
constraints, only the most relevant data are reported here. 

Firstly, the participants said to have found the game fun: “It’s a fun learning, like, 
it’s not boring or something, we enjoy it. We don’t feel like we’re learning, but 
we’re learning”. Warschauer and Healey (1998) describe this as the ‘fun factor’ 
in second language games. This ‘fun factor’ could be one reason that participants 
reported really enjoying using the Pret a negocier game (Mean: 5.29/6; SD: 1.12). 

Secondly, students found that the game helped them improve their French (Mean: 
5.25/6; SD:0.97) and that Pret a negocier is a great tool to learn a language (Mean: 
5.11/6; SD: 0.99). One possible reason for these results might be the competitive 
quality of the game where using the language effectively can lead to better game 
outcomes (see Vandercruysse, Vandewaetere, Comillie, & Clarebout, 2013 for 
different results). One student commented in an interview that “the competition is 
good I think. It makes us know more words to say what we mean”. 

Another student stated that the game helped to increase her Willingness To 
Communicate (WTC), a residt supported by related studies (Reinders & Wattana, 
2014): “It helped me to want to be able to talk more, uh... More open, in a sense, 
it made me want to talk instead of being - I’m a very shy person when it comes to 
talking in French, 1 tend to hold back, so it kinda (sic) made me want to open up and 
to expose myself’. There was a similar trend in the survey, where students felt more 
comfortable talking in French after playing the game (Mean: 4.46/6; SD: 1.09). 

Finally, some students enjoyed the collaborative aspect of the game: “Some of my 
favourite things are, just getting to talk to other people, that not only helps you but 
you get to help them too. 1 always find it rewarding when you get to help somebody 
else too. So along with improving yourself, others improve too and it just makes 
everything better”. 

The relationship between cooperative learning and WTC has been shown in past 
research (Montasseri & Razmjoo, 2015) and might be one reason why participants 
felt more comfortable speaking during gameplay than in other oral activities in 
previous French classes (Mean: 5.25/6; SD:0.97). 
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In terms of feedback on how to improve the game, students found that the pre- 
established three minute time limit to reach deals was too short. They also 
suggested that the tutorial and game onboarding needed to be made more user- 
friendly. All suggestions will be implemented in the new version of the game, to 
be released in fall, 2016. 


4. Conclusions 

Based on students’ perceptions of the game, Pret a negocier appears to be 
well-positioned to help students improve oral interaction skills in a fun and 
interactive way. Participants reported a higher level of comfort with this type 
of game interaction than with other oral activities. They also enjoyed both the 
collaborative and competitive aspects of the game, which played a role in helping 
students to feel more motivated to learn French and improve their language 
skills. This also seems to bear out in the (unpublished) preliminary results from a 
longitudinal study on the effects of game play on vocabulary acquisition, where 
we see that the game-playing experimental group outperformed the control group 
in recalling vocabulary items that they had practiced in oral interactions with 
their peers via Pret a negocier. 
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Abstract. The concept of language learner autonomy has influenced 
ComputerAssisted Language Learning (CALL) to the extent that Schwienhorst 
(2012) informs us of a paradigm change in CALL design in the light of learner 
autonomy. CALL is not considered a tool anymore, but a learner environment 
available to language learners anywhere in the world. Based on a work-cycle as a 
practical framework for implementing autonomy in online courses (Legenhausen, 
2003), the current study introduces WebQuest to be used as ideas and an activity 
bank. Work cycle design takes several principles of learner autonomy such as goal 
setting, content and format choice, self-evaluation and reflection in action and is 
defined as a learner-based approach that emphasises metacognitive knowledge that 
raises students’ awareness to become more conscious of their own language learning 
process, strengths and weaknesses (Ter Haseborg, 2012). The idea and activity 
bank at the top of a work cycle provides learners with the opportunity to plan and 
negotiate, make decisions, do project work and evaluate their learning in a cyclic 
mode. Thus, the current article argues that because of its flexibility and accessibility, 
WebQuests lend themselves to the work cycle approach in online courses aimed 
at fostering autonomy. Moreover, the findings of the current study indicate that 
WebQuests contribute to the development of learner autonomy by encouraging 
critical thinking among learners. 

Keywords: CALL, language learner autonomy, WebQuest, online language 
courses. 
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1. introduction 

Technology offers many opportunities for language learners to learn independently 
from teachers and interdependently with peers. By providing learners with 
collaborative authentic contexts, technology helps the improvement of learners’ 
autonomy through developing a “capacity for reflection and analysis, which is 
central to the development of learner autonomy” (Little, 1996, p. 210). Recently, 
the spread of the concept of autonomy in the field of CALL has resulted in a 
paradigm change (Schwienhorst, 2012), defining CALL as an environment or 
virtual community of learners influenced by pedagogy instead of a tool. 

Learner autonomy is defined as “the ability to take charge of one’s own learning” 
(Holec, 1979, p. 3). Holec (1979) believes that autonomy is not inborn but must 
be acquired either by ‘natural’ means or formal learning. Based on Holec’s (1979) 
definition, the autonomous learner is able to set goals, select tools and methods 
to follow and evaluate his/her own progress. Schwienhorst (2008) claims that 
technology is capable of assisting a learner autonomy-based pedagogy that supports 
reflection, interaction, experimentation, and participation of learners. 

The current study used the concept of work-cycle approach (Legenhausen, 2003) 
to introduce language learner autonomy in online English as a Foreign Language 
(EFL) courses. The study was part of a larger autonomous language learning 
programme conducted in a virtual language institute in Iran and the principles 
of language learner autonomy were applied using work-cycle approach. The 
cycle started with planning and negotiation on the learning goals and moved to 
decision making for the learners’ projects. Two important features of the decision 
making stage were responsibility and accountability. Learners then moved to the 
working stage in which they researched, documented and published their project. 
Finally, the evaluation stage, included learners and teacher’s evaluation of the 
project. 

Flowever, the focus of the present study was on using WebQuests as the idea and 
activity bank in a work-cycle aimed at fostering autonomous language learning. 
According to Godwin-Jones (2004), “Webquests tend to be student-oriented and 
collaborative, with students engaged in constructivist activities resulting in shared 
learning experiences and new knowledge based on enquiry-oriented language use 
and Web research skills” (p. 9). WebQuests cater for different student learning style 
needs and are appropriate for collaborative learning (Elopkins-Moore & Fowler, 
2002). A WebQuest is comprised of six components, namely introduction, task, 
process, evaluation and conclusion. 
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2. Method 

2.1. Participants 

The participants were 18 Iranian EFL language learners (both male and female), 
enrolled in virtual language courses. The course was a synchronous online course 
held twice a week and delivered through a Moodle-based course management 
system with additional features of Adobe Acrobat Connect and synchronous video 
and voice interaction. The learners were totally familiar with the features of online 
classes as they were enrolled in the online English courses and E-zaban virtual 
university for almost two years and were completing their intermediate-level at the 
time of the study. However, learners didn’t have the experience of learning English 
through work-cycles and using other online tools such as WebQuest beside the 
facilities of their virtual university. 

2.2. Instrumentation 

The WebQuest for the current study was created in zunal.com. Each work-cycle 
had a WebQuest 3 that included the sources from the web for the completion of the 
work-cycle. All students were interviewed about the possible effects of using the 
WebQuest as the idea and activity bank in an online autonomous language course. 
All the interviews were done in a virtual classroom by the teacher-researcher in 
English language. 

2.3. Procedure 

The present study was carried out during three months. Learners had completed six 
work-cycles during this period, and each work-cycle started with a WebQuest as its 
idea bank. At the beginning of each work-cycle, learners chose their favorite subject 
and the subject was chosen in a collaborative whole-class decision making process. 
The suggested sources were then collected in the work-cycle by the course instructor. 


3. Discussion 

Based on the data from learners’ interviews, WebQuests were reported as a very 
useful online tool for providing learners with ideas and activities available online. 


3. http://zunal.com/webquest.php?w=311179 
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The WebQuest also fit work-cycle approach in that it was open for change during 
the whole cycle. Moreover, the sections of a WebQuest, namely introduction, task, 
process and evaluation provided learners with clear guidelines for the rest of the 
work-cycle. 

Learners reported many advantages of using a WebQuest. The codes extracted 
from learners’ interviews regarding the advantages and disadvantages of using the 
WebQuest as an idea and activity bank are presented in Table 1. 


Table 1. Learners’perceptions about using WebQuest 


Theme 

Code 

Example 

Positive perceptions 

Fast 

It was faster than searching 
on my own. 

Easy to find 
learning material 

Everything is ready but 
we can add too. 

Variety of material 

I could choose to read, or 
listen to the chosen topic. 

Related parts 

There is no irrelevant 
material like the internet. 

Cooperation 

I liked it when the teacher added 
my choice to the WebQuest. 

Negative perceptions 

Not fixed like a syllabus 

I was worried about missing 
the recently added materials. 

Pdf files are fixed. 


Our results suggest that the positive features of using the WebQuest as an 
idea and activity bank outperformed its negative points. The interview results 
revealed that WebQuest was found useful as it helped learners save the time of 
their inquiries from the web. It also helped the development of critical thinking 
abilities as learners reported on the possibility of having variety of related material 
and synthesising the available information for optimal learning. However, 
some learners still preferred a pre-planned structured syllabus presented at the 
beginning of the course to avoid the dynamicity of using the WebQuest as an idea 
and activity bank. The findings of the current study were in line with the study of 
Torres (2007), who found WebQuest useful in learning because of its ability to 
promote the effective use of time and structuring learners’ search for information. 
Moreover, as students were engaged with reading, thinking, synthesising, and 
evaluating the existing information in the WebQuest to manage their work- 
cycles, they could gain critical thinking abilities (Halat & Peker, 2011). in line 
with the findings of the current study, Cai (2005) asserts that using WebQuest 
helps students become better learners by increasing their autonomy level and 
providing a sense of fulfilment. 
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4. Conclusions 

The results of the present study showed the potential of WebQuest to be used as 
the idea and activity bank in online autonomous language courses. As flexible 
and dynamic idea banks, WebQuests be adapted according to the need of learner 
throughout a cycle. 
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Abstract. This report is based on an exploratory case study of a private multilingual 
preschool language program that integrated a Mobile-Assisted Language Learning 
(MALL) project into the curriculum of five/six year-old children whose native 
language(s) is/are Russian and/or Tatar. The purpose of the study was to reveal 
teachers’ and parents’ perceptions of the educational value of mobile language 
learning in English as a Foreign Language (EFL) classroom and explore the case 
of MALL integration into the curriculum of young language learners. To collect the 
data, the researchers surveyed eight teachers, including a teacher who introduced 
the MALL project into her class of 12 children, as well as 12 parents whose children 
participated in this project. The results speak for the growth of MALL enthusiasts 
among teachers and the lack of MALL supporters among parents. 

Keywords: mobile-assisted language learning, MALL, early childhood education, 
EFL. 


1. introduction 

The educational value of mobile devices for young learners has been questioned 
by many educators and parents. While many instructors demonstrate a positive 
attitude to the usage of mobile technologies in the adult classroom (AL-Maagb, 
2016; Tai & Ting, 2011), educators have less enthusiasm towards their educational 
value with younger students (Shuler, 2009). Parents, in turn, allow children to use 
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mobile devices even when they do not recognize their educational benefits (Chiong 
& Shuler, 2010). 

This report is based on a case study built around a MALL program that was designed 
and integrated into the curriculum of five/six year-old children. The report focuses 
on the instructors’ and parents’ perception of MALL educational value for very 
young foreign language learners. 


2. Method 

This exploratory case study was designed to document and analyze efforts of a 
private multilingual kindergarten and preschool that enhanced the language 
curriculum with iPad tasks. Located in Kazan, a Russian city with a multicultural 
population, this school for children from ages two to six emphasizes the importance 
of early multilingual education and promotes a curriculum that enriches native 
(Russian and Tatar) language developmental programs with English, Spanish 
and Chinese language classes. In late 2015, teaming up with experts in English 
teaching and educational technologies, the school designed a small-scale program 
with mobile English language activities for a group of preschoolers (N=12) who 
had previously studied English for two and a half years. In spring 2016, Reading 
Eggs™ (http://readingeggs.co.uk/), an internationally recognised Australian 
program with online reading games and activities for children aged three to 13, 
was selected as an appropriate mobile application introduced into the curriculum 
of 12 children whose native language(s) is\are Russian and\or Tatar. 

The leading teacher of the class that participated in the study reviewed the Reading 
Eggs™ application and redesigned her regular English language curriculum to 
integrate activities suggested by the program. Due to the lack of mobile equipment 
in school, the Reading Eggs™ activities were suggested for homework to enhance 
language skills developed in class. The leading teacher registered each child to the 
mobile application and modeled learning tasks in class to children and after class 
to each parent individually. As the school promotes active parent-to-child learning, 
parents were encouraged to supervise and guide their children when they were 
on the mobile device. The children completed activities at home on their iPads 
for 30 days (the period of free trial of this commercial application). The activities 
suggested by the Reading Eggs™ application included picture recognition, word 
comprehension and voiced books with reading/listening comprehension questions. 
The application was used to enhance reading and listening comprehension skills 
in support of the content material covered in the classroom. The leading teacher 
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regularly checked if students completed homework activities and evaluated 
their progress by incorporating Reading Eggs™ tasks into class work. She also 
administered a test after the 30-day project. 

While the case study collected data to get in-depth understanding of the conditions 
and results of the MALL activities integrated into the curriculum of young language 
learners, for the purpose of this report the following research question is selected 
as focal point: What are the teachers’ and the parents’ perceptions of integrating 
MALL into very young second language learners’ curriculum? 

Parents of 12 children who participated in the MALL activities, as well as all 
English teachers of the multilingual school, including the leading teacher of 
the target children group, were asked to complete paper-based questionnaires 
consisting of one open- and four closed-ended questions. 12 parents and eight 
teachers responded to the questionnaires. 


3. Results and discussion 

Responses from Question 1 of both questionnaires established that the survey was 
completed by school teachers who worked with children from ages two to seven 
and by parents of five/six year olds. 

Question 2 of the teacher questionnaire stated “Do you use any educational 
mobile applications for English language teaching? If yes, please, name these 
applications". The responses indicated that three teachers (37.5%) used mobile 
applications for language learning and five (62.5%) had not yet adopted MALL for 
their teaching practices. When parents were asked the same question in regards to 
their own children, all 12 of them named Reading Eggs™ as the application in use 
by their children. 

Question 3 in both questionnaires stated “Do educational mobile applications 
facilitate kindergarteners’ language learning?'". The question referred to teachers’ 
and parents’ general perceptions of MALL effectiveness and no additional guidance 
was given. However, as the questionnaire was administered after the 30-day 
project was completed, it was assumed that parents woidd base their answers on 
observations of their children learning with the Reading Eggs™ application. The 
teachers’ responses demonstrated that they shared the belief in the high educational 
value of MALL; none of them questioned language learning potential of mobile 
applications irrespective of whether they used them or not. Parents, in their 
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turn, did not demonstrate unanimity. One parent (8.3%) fully agreed that mobile 
applications enhance language learning among kindergarteners, 66.7% were not so 
certain and others (25%) expressed their doubt that mobile applications can assist 
in language learning. These results were later clarified in the interview with the 
leading teacher of the target children group. She explained that while all 12 parents 
were aware of the Reading Eggs™ application and were encouraged to support 
their child’s MALL experience, only seven parents did so and only four children 
participated in mobile language activities on a regular basis. This indicates that not 
all parents whose children were supposed to be involved into the project did have 
a chance to experience MALL benefits and therefore they might have based their 
opinion on unjustified common beliefs. 

Question 4 asked the teachers and parents to characterize language learning 
applications by selecting one or more answers from a list of ten options. The 
majority of the teachers found language-learning applications beneficial since they 
entertain, teach, motivate and enable teachers to diversify their lessons. Still, more 
than half of the teachers thought that mobile applications might cause addiction 
(62.5%), while a quarter of respondents (25%) believed that they did not teach at all 
and limited social interaction. One teacher believed that mobile phones increased 
the risk of eye damage. 

In contrast to the teachers, the parents turned out to be technology pessimists. 
Most parents found language-learning applications harmful and causing problems 
such as eye damage (66.6%) and addiction (58.3%). 33% of parents agreed that 
mobile applications limit social interaction, 8.3% of parents believed that mobile 
applications distract children from studies and are of no benefit in general. However, 
half of the parents admitted that mobile applications entertain, teach and motivate, 
25% of parents believed that mobile applications may diversify lessons, and 8.35% 
of parents described apps as ‘effective’. 

Question 5 of the parents’ questionnaire, which aimed at examining overall 
children’s involvement into the digital culture, stated “ Does your child use any 
mobile applications (games etc.) Out of 12 parents, the majority (91.6%) reported 
that their children used mobile applications. One parent answered that his/her child 
did not use mobile devices. However, when cross-checking with Question 2, it 
became evident that the child did use one mobile application - Reading Eggs™. 

In the teachers’ questionnaire, Question 5 stated “ What difficulties can arise/arose 
when using mobile technologies in EFL classrooms in a group of kindergarteners?”. 
The teachers could select answers from a list of 5 options or give their own answer. 
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All the teachers thought that using mobile applications was challenging because 
they might lack access to a mobile device. Another problem that was noted was 
teachers’ inability to use mobile applications with certain groups of students; 
particularly learners’ very young age was seen as an obstacle. The teachers were 
also concerned about their insufficient knowledge of methodology of using mobile 
technologies for educational purposes and their inexperience in the sphere of 
mobile technologies in general. 


4. Conclusions 

MALL projects gradually find their place in the curriculum of young language 
learners. The study indicates that most parents may not share enthusiasm of 
teachers about high educational potentials of modern mobile applications for 
developing literacy skills, including foreign language literacy. Moreover, the 
findings suggest that while integrating MALL activities into homework can 
sometimes solve the problem with the lack of appropriate mobile devices in 
schools, some parents may not be ready to assist their children with mobile 
language learning tasks. Further research is needed to provide evidence-based 
recommendations on the effective ways of integrating mobile activities into the 
curriculum of very young foreign language learners. While each case has unique 
MALL integration conditions, projects similar to the one described in this report, 
may assist researchers and practitioners in building an understanding of the hows 
and whys MALL projects could work in a given educational context. It is our 
hope that school teachers’ enthusiasm about MALL will help to overcome some 
parents’ apparent disinvolvement and skepticism about MALL benefits discussed 
in this study. 
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Abstract. This work presents the assistive use of a combination of technologies in 
language learning to individuals with high functioning disabilities within a higher 
education environment. The primary aim of this research is to introduce the initial 
findings of a pilot exploratory user test which aims to facilitate a better understanding 
of the suitability and user preference of technological tools in language learning; 
specifically of children with disabilities. In this article, we present a case study of 
ten young adults with different levels of needs and abilities, including dyspraxia, 
dyslexia, dysgraphia, attention deficit disorder, articulation, learning difficulties and 
psychological problems. The learners, engaged in different disciplines in higher 
education, were exposed to bespoke and off the shelf solutions as assistive technologies. 

Keywords: language learning, learning difficulties, technology. 


1. Introduction and motivation 

This paper presents a case study of young adults with different levels of needs and 
abilities undertaking different disciplines in higher education. The students attend 
an English language course in which certain technologies such as educational 
softwares and devices are utilized in order to facilitate their learning and enhance 
their motivation. The instructor is faced with the challenge of designing an English 
for specific purposes course and at the same time tailor it with the individual needs 
of students (Bocanegra-Valle, 2010). The course effectiveness depends on the 
content attractiveness in combination with the feeling of achievement on the part 
of the students. 
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The teaching and learning process becomes challenging when this involves 
students with learning difficulties (Lackaye, Margalit, Ziv, & Ziman, 2006). 
Strategic planning and curriculum adaptations are thus considered essential, and 
making necessary changes in the curriculum enhances the learning of students with 
special educational needs (Ainscow et ah, 2006). Based on anticipated learning 
outcomes, educators need to make the correct decision-making in terms of the 
teaching material and tools implementation (Marek, 2014). Technology has proven 
to be an assistive tool due to the fact that it offers students with special educational 
needs the ability to engage in ways in which adapts to their individual needs 
and abilities (Edwards, Blackhurst & Koorland, 1995 mentioned in Fernandez- 
Lopez, Rodriguez-Fortiz, Rodriguez-Almendros, & Martinez-Segura, 2013, p. 22). 
Educating students with special needs can utilize technology to increase their focus 
on tasks to be performed (Fernandez-Lopez et al., 2013, p.78). Kukulska-Hulme 
and Traxler (2007) suggest that mobile technologies amplify all kinds of learning 
including “personalized, situated, authentic and informal learning” (cited in Jones 
et ah. 2013, p. 22). That is to say, mobile technology learning has been successfully 
implemented in location based inquiries where learners were asked to explore their 
educational environment and take an active role in their own learning. 

However, what needs to be taken into consideration for students with special 
needs is that educators should seek for technological devices or softwares which 
are simple and user-friendly (Marek, 2014). It has been found that ‘text-based 
synchronous activities’ may disadvantage those with disabilities due to their 
difficulties in reading, writing and spelling (Woodfine, Nunes, & Wright, 2008). 
In contrast, the findings highlight that the specific learners are more comfortable 
in composing a text due to the nature of an asynchronous environment than in not 
immediately having to respond, which enables them to both prepare better as well 
as feel less rushed to provide a response (Woodfine et al., 2008). Technology and 
the internet have also been applied in teaching Languages for Specific Purposes 
(LSP) in a way that they have generated tools which assist in providing students 
with a realistic experience in terms of their social perspective of things (Arno- 
Macia, 2012). 


2. Methodology 

The course lasted for one or two academic years (nine month period per year) 
with students in groups of two to four receiving two sessions a week, between 
one to two hours. The course began with one-to-one meetings with the students, 
after a liaison with the educational psychologist, where they were assessed by 
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being asked to write about themselves. This assessment includes an evaluation 
of their abilities such as handwriting, spelling, structure and language level. 
After completing the individual assessment, a discussion is initiated between the 
professor and the student which enables the professor to gather further information 
concerning the students’ English language experience, diagnoses, level of support 
they have received as well as its effectiveness and difficulties they would like to 
report on. This material is then used to match the students’ individual requirements 
with their learning expectations and also match appropriate technologies to each 
group. In order to engage the students and improve the learning process, a series 
of technologies are implemented in the classroom environment to involve the 
students in individual activities. 

The assistive technology tools adopted by the instructor included Google Drive 
and Google Sites for uploading and sharing classroom material and assignments, 
PowerPoint and Prezi which served as presentation tools, Wordle, QR codes and 
Instagram for reading and vocabulary purposes, Glogster for producing written 
work, Kahoot software for revising the course material before the midterm and final 
exams and Pathbrite for creating an E-Portfolio at the end of the semester. It should 
be noted that the Bring Your Own Device (BYOD) system was followed in class 
through which learners accessed the lecture work and material via their laptops, 
iPads or smartphones. In order to gather data from our participants, a questionnaire 
was implemented with questions relevant to the course design. The questionnaire 
was handed out to the students at the completion of the semester. It comprised of 
fifteen questions including both open and close-ended questions. The questions 
revolved around three main themes: (1) the leamability of the technologies, (2) 
the usefulness of the technologies, and (3) the usability and user satisfaction of 
the technologies. Likewise, also examined was whether they feel their English had 
improved during the semester. 


3. Findings and discussion 

3.1. The leamability of the technologies 

Most of the learners (seven out of ten) commented on both the Google Drive 
and Google Sites being user-friendly and practical since by the end of the course 
they became accustomed to their use. However, Wordle seemed to have had a 
negative impact on the students who expressed their difficulty in tracing the words 
and explained that the jumbled characters were really hard to recall. Likewise, 
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Glogster was deemed ‘user unfriendly’, thus learners found it extremely difficult to 
experiment with its format and tools. Nevertheless, there was an agreement among 
students (eight out of ten) in the ease the Pathbrite E-Portfolio provided them with. 

3.2. The usefulness of the technologies 

This theme revolves around the idea of utilizing technologies with effective 
learning tools. There was a consensus in the participants (nine out of ten) who 
stressed the significance of PowerPoint during the lecture due to the fact that it 
contains all the keywords and important details in combination to audiovisual 
material (pictures, videos, etc.). Based on the learners’ comments, QR codes turned 
the whole learning experience into an enjoyable moment through which students 
became more motivated to learn. Surprisingly enough, Instagram was thought to 
be quite monotonous and six out of ten students stated their lack of interest in using 
lecture-related hashtags. Conversely, all learners showed a great preference towards 
Kahoot which they stressed had boosted their memory and therefore developed 
their learning. Generally, the results interpretation highlights that the use of mobile 
devices and computer software increased the participants’ confidence; both their 
linguistic knowledge and technology skills have been developed. 

3.3. The usability and user-satisfaction of the technologies 

This category was created to refer to the pleasure the technologies offered the 
participants. The majority of the students (eight out of ten) found Google Drive 
and Google Sites extremely convenient even though at the beginning of the course 
only a few of them used a Google account. For this reason, they expressed their 
preference for using Google Drive for storing documents and files in general. Prezi 
undoubtedly outweighed PowerPoint since, according to eight out of ten students, 
“it is more attractive and memorable”. Equally, QR codes were awarded as the 
most enjoyable and effective technology medium and all learners were engaged in 
the activity. Finally, a great number of students (seven out of ten) enjoyed creating 
the Pathbrite E-Portfolio due to the fact that they could gather all their assignments 
and course work in one folder. 


4. Conclusions and future work 

In this paper we presented a series of technologies to students with disabilities 
and encouraged their use throughout a language learning course. We report on 
initial findings which provide us with evidence of usage and user satisfaction of 
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the technology’s use. We aim to build from these findings an initial framework of 
technologies that can be promoted for language learners with disabilities through 
longitudinal and larger scale structured testing. 
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Learning languages in 3D worlds with Machinima 

Christel Schneider 1 



Abstract. This paper, based on the findings of the EU funded CAMELOT project 
(2013-2015), explores the added value of Machinima (videos produced in 3D virtual 
environments) in language learning. The project research evaluated all stages, from 
developing to field testing Machinima. To achieve the best outcome, mixed methods 
were used for the research, including quantitative and qualitative techniques of data 
collection, such as questionnaires, interviews and focus group discussions. The data 
were provided by teachers and learners using Machinima in their classroom, as well 
as by learners participating in web based language courses of which all results were 
well documented in the form of case studies. 

Keywords: language learning with Machinima, 3D virtual environments, video 
production. 


1. introduction 

Considering that more and more videos are utilised for educational purposes to 
enhance users’ learning experiences, the EU-funded project ‘CreAting Machinima 
to Empower Live Online Language Teaching and Learning’ (CAMELOT 2 ) assesses 
the design and usability of video captures, which are film recordings of 3D virtual 
experiences (Machinima). Based on the CAMELOT project (2013-2015) which aims 
to promote learning in 3D virtual worlds and trigger interest in teaching and learning 
in these immersive environments, my study investigated two Machinima Open 
Online Training courses (MOOT) designed for language educators to learn how 
to create videos (Machinima). The term Machinima is a neologism, derived from 
merging the words ‘machine + cinema’, first used in the late 1990s (Marino, 2004). 
In the context of language learning, Machinima are closely related to independent 
filmmaking as they follow a similar process, which includes design, storyboarding, 
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filming and editing. The study results indicate that learners involved in the creation of 
Machinima gain a better understanding of the impact immersion in 3D virtual worlds 
has on the learning process and learning outcomes. 


2. Method 

For the research, a mixed method approach was chosen, composing several case 
studies triangulating participating observation with qualitative and quantitative 
data. This appeared to be particularly useful in cases where questions could not 
be answered by one method alone (Creswell, 2014). Core areas of the study were 
carried out in the form of participating observation during the MOOT courses, 
including synchronous training sessions in Second Life® (SL) and in Adobe 
Connect™, as well as asynchronous session observations on Moodle. The sessions 
on Moodle prepared the learners to create their own Machinima with a specific 
focus on grammar, a narrative, or instructions for the level and language required 
in the physical or virtual language classroom. The activities on Moodle included 
discussions, feedback, self-assessment and surveys. The skill practice for creating 
and editing Machinima took place in SL and Adobe Connect™. Additionally, 
expert interviews with Machinimatographers and teachers using Machinima with 
their learners were conducted via Skype or in SL. For the field testing research, a 
series of Machinima of different styles, formats, language levels and languages, 
created for the CAMELOT project, were piloted at the University of Istanbul, 
the National Defence University in Warsaw, the University of West Bohemia, a 
Secondary Content and Language Integrated Learning School in the Netherlands 
and by LinguaT V, a video based online language course provider. Of all the courses 
piloted, 726 learners from higher education, adult education, secondary education, 
primary schools and one class of students with special needs in a secondary school 
responded to the survey. The field testing research was based on focus group 
discussion reports using guided questions, teachers’ reports, and questionnaires 
completed by teachers and students (CAMELOT, 201 5). 

3. Discussion 

3.1. Creating Machinima - benefits and challenges 

During the two facilitated MOOT courses, enough space wasprovided for developing 
social presence, essential for successful collaboration and group activities, such 
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as creating a storyline or exploring different roles and outfits of avatars. It was 
observed how the activities in SL encouraged interaction and bonding and thus 
increased mutual support and motivation among the participants, which resulted 
in a high attendance level and course completion (Wheeler, 2005). Apart from the 
technical skill set needed to create Machinima, the MOOT courses provided space 
for discussing challenges and advantages of learning in 3D environments. Some of 
the benefits discussed were that the learners were not just consumers of content, 
but became actively involved in the production process (Corrigan, 2014). Further 
shared advantages were that learners perceived as shy in the physical classroom 
opened up and became more confident when performing in the virtual environment 
(De Jong Derrington, 2013). 

3.1.1. Time and effort 

Experts and practitioners had very opposing experiences in regards to the time 
needed for creating Machinima. Hancock and Ingram (2007) state that creating 
Machinima is much faster than shooting real life films, whereas Morozov (2008) 
argues that the whole process of Machinima production can be quite challenging 
as it requires a complex set of skills. The actual time spent on the creation of 
Machinima on the MOOT varied quite a bit, depending on people’s skills, technical 
barriers, personal commitments and goals (Schneider, 2016). 

3.1.2. Quality of Machinima 

The quality of Machinima was discussed in regards to the expected outcomes of 
Machinima productions and the way they were perceived by users. None of the 
Machinima created during the MOOT could be expected to be highly professional. 
However, teachers accepted their self-created Machinima more easily if they 
conveyed the learning content in a suitable way (Schneider, 2016). Their learners 
did not care about the quality of Machinima as long as the content triggered their 
interest, and the fact that their teacher had created them was especially appreciated. 
Yet, the evaluation of field testing surveys showed that some Machinima were 
considered to be of poor quality, because of the lack of non-verbal expressions and 
the unnatural looks and movements of avatars. 

The findings imply that the quality of Machinima is often determined by the 
user (Schneider, 2016). Discussions with practitioners revealed that regardless 
of imperfections, quality is secondary as long as the Machinima are relevant, 
include a fun element and are used as a learning tool, involving learners in the 
production process. Nonetheless, other examples showed that the quality of 
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Machinima did matter when using other people’s video productions. Teachers 
and learners unfamiliar with virtual environments or 3D games tended to critique 
ready-made Machinima because they could not identify with the avatars or even 
rejected them. Perceptions of avatar aesthetics and the lack of seriousness also 
had an effect on some learners in their engagement with ready-made Machinima 
(Schneider, 2016). The following excerpts from the CAMELOT MOOT course 
2015 demonstrate the different stages of Machinima productions and skill sets: 
https://youtu.be/GopJmoH3-s4. 

3.1.3. Learners’ involvement 

Various language facilitators who were interviewed about teaching in 3D virtual 
worlds all shared the experience that engaging learners in the process of making 
Machinima is significantly more important than the actual Machinima. Some were 
even convinced that their students learn better and even faster by being involved 
in the production process. Considering that active involvement in Machinima 
production is essential for successful language learning, the value of including 
learners in the reflection and feedback discussion appears even more important. 
Machinima recordings allow learners to review their interactions by reflecting on 
their performance, and make improvements by re-shooting the scenes they are 
not satisfied with. Watching the recordings of their activities in a role-play, for 
example, helps learners to review and analyse their performance and develop an 
awareness of the language used. 

3.2. Field testing Machinima 

The Machinima piloted were ready-made, including teaching guides and materials. 
As the focus group discussions revealed, people’s opinion about advantages and 
disadvantages of ready-made Machinima were quite different. Some teachers 
benefitted from ready-made Machinima as it saved them preparation time, whereas 
others criticised that the language level did not suit their students’ needs. The 
option of creating their own Machinima was considered too demanding in regards 
to the required skills, equipment and lack of institutional support. It was agreed that 
ready-made Machinima that focused precisely on what was needed in the lesson 
were most efficient. 

It is remarkable that of the 726 students piloting ready-made Machinima in their 
lessons, 75% felt comfortable about the learning experience, though the majority 
preferred traditional videos (CAMELOT, 2015). Issues addressed by the learners 
were the missing facial expressions and gestures of avatars and their artificial 
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appearance. In some cases, poor sound quality and bad graphics added to the 
critical assessment (Schneider, 2016, p. 41). Regardless of all critical comments, 
most piloting teachers reported that their learners felt inspired and attracted by the 
novelty of using Machinima in the classroom on top of learning something new; 
they also had fun and enjoyed the lesson. Younger students did not seem to have 
problems with the avatars or environment as they were used to virtual characters 
from computer games (Jauregi et ah, 201 1). 


4. Conclusions 

It can be determined that the most effective and rewarding Machinima were 
the ones that involved the learners in the production process, which none of the 
students experienced as a ‘waste of time’. It is essential for the learning process 
to immerse in 3D virtual environments to understand the benefits of this kind of 
learning. Positive experiences through active participation, interaction, mutual 
support and community building have proven to have a great impact on teaching 
and learning with Machinima. 

As far as the study revealed, it could not be foreseen whether a particular 
Machinima appealed to a specific group of students or not and whether learners 
achieved more than they would have done without the use of Machinima. To find 
out more about the influence of Machinima on language learning, additional and 
long term research would be necessary to examine which genre of Machinima 
appeals to different types of learners. 
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classrooms: textbooks or podcasts? 
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Abstract. In the 21st century it has become clear that more and more language- 
learning pedagogical materials have begun to shift to a digital mobile-access format 
and away from being a textbook and classroom based one. High quality language- 
learning podcasts can provide a cheap, beneficial and portable technology that allows 
learners the freedom to access useful materials whenever and wherever convenient - 
especially through smartphones. However, despite the low cost involved in producing 
and accessing podcasts, educational institutions still seem reluctant to fully utilise 
them as an integral part of the language-learning process. This presentation will 
outline the structure of a comprehensive study that analysed the communicative 
abilities of 102 university freshmen students undertaking a compulsory English oral 
communication course. The study was divided into a traditional model that was 
centred-around a paper textbook and digital model where no textbooks were used 
and the course was structured around a series of high-quality, pedagogically sound 
English language podcasts. It was found that students progressed in similar ways 
during the course, regardless of the pedagogical materials used. 

Keywords: podcasts, mobile assisted language learning, authentic materials, 
smartphones. 


1. Introduction 

In a comprehensive study, the English communicative abilities of 102 university 
freshmen at a Japanese university were analysed in detail during one semester. 
Two instructors each taught two classes; the first being a traditional model which 
was structured around a textbook, whilst in the other course a digital model was 
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implemented which utilised high-quality, pedagogically strong English language- 
learning podcasts. Following Lauer, Selwood, and Enokida (2016), a series of 
communicative language-learning tests were administered at the beginning, middle 
and end of the semester to assess the student’s progress. The experimental model 
used in this study partially mirrored an influential study published by Gilmore 
(2011), which concluded that utilising authentic materials - which were mostly 
Internet-based - seemed to be more effective than traditional English-language 
learning textbooks. Thus, the goal of this study was to confirm Gilmore’s (2011) 
findings by determining which pedagogical materials were more effective in 
improving students’ oral abilities: textbooks or podcasts. 

This paper will outline how the study was implemented, state the benefits that can 
be found through using non-authentic language learning materials, and report on 
the results of the tests administered. 


2. Background 

The study attempted to determine if podcasts are more effective than textbooks 
in improving students’ English communicative abilities. Significantly, podcasts 
can be accessed through mobile digital devices such as smartphones or tablets. 
The potential of podcasts as a language-learning tool is that pedagogically 
strong podcasts can provide high-quality ‘authentic’ materials. As Bishop, 
Amankwatia, and Cates (2008) explain, “podcasts have the power to focus 
attention and assist language learners to acquire useful and authentic language” 
(pp. 467-486). 

English Language Teaching (ELT) textbooks, on the other-hand, often provide 
learners an impoverished or distorted view of the native language (Gilmore, 2007). 
The dialogues in textbooks are often centred-around contrived utterances, with 
the goal often being to illustrate a particular grammar point whilst highlighting 
frequent, easy to understood but unnatural vocabulary. 

Podcasts also have the potential to motivate because they are often published weekly 
or monthly and so students are provided with information as events unfold, whilst 
textbooks can often include language that has been specially adapted, thus losing 
its authenticity whilst often containing information and facts that soon become 
out-of-date. Another factor that is often undervalued is that most language-learning 
podcasts are free, so podcasts can offer a more egalitarian method to language- 
learners as the materials can be accessed free of charge. 
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The ultimate aim of a language-learning course should be to improve students’ 
language abilities and communicative competence. Traditionally in Japan, ELT 
textbooks are the go-to authentic material used on language-learning courses. Yet, 
in a prominent study, Gilmore (2011) concluded that students at a university in 
Japan significantly improved their communicative competence over a ten month 
period when they used web-based materials compared to a similar group of 
students who used only textbooks. The authors wanted to evaluate how successful 
podcasts could be when used as an essential tool in an English communicative 
course. By using Gilmore’s (2011) study as a starting point, they wished to contrast 
and evaluate the effectiveness of podcasts in comparison with textbooks. 


3. Method 

Two of the authors - Selwood and Lauer - each taught one podcast-centred 
course and one textbook-centred course. Each author chose different textbooks 
and podcasts to be used in the study. The podcasts selected by Selwood were 
English News Weekly, English News Students, BBC Six Minute Podcast and 
BBC The English We Speak. Lauer chose four different podcasts and these were 
Hiroshima University s English Podcast, VOA Podcast, Daily English Show and 
ECC Podcast. Selwood selected English Speak (Selwood, 2014) as his textbook 
whilst Lauer chose Slumdog Millionaire (Close, 2010). All the materials were 
selected because of their high pedagogical quality and their usage of authentic 
language. 

Each course lasted for one 15-week-semester and each class was 90 minutes 
in length and held once-a-week. Both the textbook and podcast courses were 
compidsory first year English communication classes. The students were assigned 
to each class depending on their faculty and their university entrance exam score 
and the TOEIC test (the standard English language test used in Japan - the highest 
score is 900 points). Lauer’s textbook class had an average score of 540/900 whilst 
his podcast class was 419/900. In contrast Selwood’s podcast class was 629/900 
whilst his textbook class was 467/900. This meant that each author had a ‘weaker’ 
and ‘stronger’ ability class and so the study could be measured amongst students 
of differing abilities. 

To assess students’ progress, three sets of tests were included in the survey - at the 
beginning, middle and end of the semester. The tests focused on grammar, listening 
and speaking because according to Canale and Swain (1980), these are the essential 
parts in measuring and analysing communicative competence. The three tests were: 
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• Communicative Vocabulary-Grammar Test. This measured students’ 
vocabulary and grammar skills. This test contained 49 questions, taken 
from a standard TOEIC test and the same 49 questions were used in all 
three tests, albeit with the question order changed from test to test. 

• Communicative Listening Test. This measured general listening ability 
through 21 questions taken from a TOEIC practice test. Again the question 
order was re-arranged for each test. 

• Three Minute Recorded Speaking Test. For this test students were 
placed in pairs and for three minutes the students entered into a dialogue 
recorded using smartphones. The audio was then emailed to their teacher 
for analysis. 


4. Results 

The Communicative Vocabulary-Grammar Test results showed only a tiny 
improvement in both courses. In the textbook classes the average score increased 
from 69% to 72% whilst the podcast courses showed a tiny increase from 69% 
to 70%. However, the stand-out result from the study was the improvement in 
Communicative Listening Test results in both courses. The textbook students 
improved their listening scores from an average, per student, from 43% to 54%. 
The podcast students also improved from an average score of 39% to 51% by the 
end of the semester. 

The Three Minute Recorded Speaking Test also showed small improvements in 
both courses. In the podcast course, each student, on average, increased their word 
count by 15 words per three minutes. However, in the podcast courses students 
only increased, on average, by seven words per three minutes. 


5. Conclusions 

The study found that, disappointingly, there were no differences in which authentic 
materials were used. The textbook courses worked just as well as the podcast ones. 
However, there were mitigating factors to why these results occurred. Firstly, the 
length of the study was only four months. Secondly, each class met just once a 
week for 90 minutes. Thirdly, the testing method used to assess the project was 
hindered by using the TOEIC test as this measures listening ability, vocabulary 
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knowledge and speaking skills. However the test is limited in how it measures 
students’ sociolinguistic abilities, discourse and strategic skills. The authors used 
this testing method as it had been used in Gilmore’s (2011) study as well as being 
the pre-eminent English language test used in Japanese universities. 

In the future, researchers wishing to investigate the merits of podcasts should 
focus on correcting the problems encountered by the authors on this study, namely 
expanding the length of time the study runs for. 
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Abstract. This paper focuses on the possibilities/challenges for English as a Foreign 
Language (EFL) teachers designing tasks grounded in Task-Based Language 
Teaching (TBLT) and taking advantage of the affordances of technology - Interactive 
WhiteBoards (IWBs). Teachers have been shown to confuse tasks with exercises 
or activities. The interactive Technologies in Language Teaching (iTILT) projects 
revealed that when it comes to IWB use the focus often shifts from interactive 
teaching to interactive technology. To better prepare novice EFL teachers for their 
future teaching practice, an ‘IWB for TLBT’ training programme introduced the 
affordances of IWBs. Our analysis of how (un)successful they were at marrying 
TBLT and Information and Communication Technology (ICT) operationalised 
TBLT criteria from Nunan (2004) and Erlam (2016). Supporting evidence of the 
participants’ aptitude in TBLT practice is provided by a traditional, non-IWB- 
oriented task each individual had designed earlier. Combining both elements in the 
analysis, our study answers the question: to what extent are pre-service teachers able 
to design a TBLT environment involving modern technology that adheres to iTILT 
principles and current theories of TBLT methodology? 

Keywords: TBLT, task design, EFL, IWB, teacher education. 


1. Introduction 

The objective of the European interactive Teaching In Languages with Technology 
(iTILT2) project, launched in 2014, is to explore the affordances of devices like 
smartphones and IWBs. More specifically, it investigates the effective use of 
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these interactive technologies within a TBLT approach. iT!LT2 builds on, and 
extends, the EU project iTILT, focusing on lWBs for teaching foreign languages. 
However, iTILT2 moves beyond lWBs and includes effective educational design 
for foreign language learning with a wider range of new interactive technologies 
(tablets, laptops, mobile phones, videoconferencing software). The educational 
contexts vary from primary and secondary schools to vocational colleges and 
universities. 

TBLT theory is central to 1T1LT2 and requires students to do meaningful tasks in 
the target language, having to choose for themselves the linguistic means for task 
completion. A task is “an activity in which people engage to attain an objective 
and which involves the meaningful use of language” (Van den Branden, Van 
Gorp, & Verhelst, 2007, p. 1). An objective can be anything from producing a 
poster or website to expressing opinions or writing song lyrics. As learning the 
target language means making use of it, learners are primarily seen as language 
users. 

Research shows that many language teachers find it difficult to distinguish tasks 
from simple grammar exercises or activities for vocabulary practice. To help 
teachers, Shintani (2013) discussed the principles behind TBLT and outlined the 
main features of language learning tasks: 

1. activity focus is on meaning, i.e. learners encode/decode messages, no 
grammar or vocabulary drilling; 

2. communicative/information gap, e.g. learners need to ask for information 
they do not have (= gap) or need to express their opinion; 

3. learners draw on their own (linguistic/non-linguistic) resources to 
complete tasks. They are not ‘taught’ the language nor the form to use to 
complete the task but are free to choose their ‘means’, although they could 
for example borrow from the input, use dictionaries/online resources, ask 
the teacher, etc.); 

4. clearly defined outcomes other than mere language use, e.g. poster, 
form, handout, opinion, or reaching a compromise in discussions. While 
“performing a task, learners are not primarily concerned with using the 
language correctly but rather achieving the goal stipulated within the task” 

(Ellis, 2003, p. 35). 
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2. Method 

2.1. Dataset 

Our study goes beyond Erlam’s (2016) by not limiting itself to applying 
criteria for task design (e.g. from Ellis, 2003, in Erlam’s (2016) study) to 
evaluate foreign language teachers’ self-made TBLT materials in a professional 
development programme; we also consider the conception of a task in the minds 
of (postgraduate) pre-service foreign language teachers (N= 28) by analysing a 
design task that had them formulate a taaltaak (integrated language/assessment 
task). Consequently, the dataset exists of (1) materials designed for use with 
the IWB, part of (the evaluation of) a series of lessons on TBLT, and (2) the 
somewhat more traditional taaltaken. 

The latter tasks the participants designed before the IWB technology was introduced 
had to contain a step-by-step description with process and product requirements for 
one or more open-ended B1 tasks fostering the autonomous use of (a) language 
skill(s) in an authentic context. The choices student teachers made when designing 
these tasks revealed what they consider meaningful language use for learning and/ 
or open communicative contexts. 

Each set of IWB TBLT materials (i.e. the aforementioned (1)) consisted of a lesson 
plan and the TBLT materials for the IWB (Smarttech Notebook®). The assignment 
required student duos to plan a lesson on a cultural topic with B1 TBLT activities 
involving the IWB and to develop accompanying materials. 

2.2. Data analysis 

The criteria to analyse the pre-service teachers’ TBLT approach and materials 
against were inspired by Nunan’s (2004) aspects of qualitative task design: task 
objective, input quality, quality of activities, classroom setting, and teacher and 
learner roles. 

Given our study’s affinities with Erlam (2016), an evaluation grid was used that is 
based on the central features of TBLT in Nunan’s (2004) paradigm and includes 
some of Erlam’s (2016) task criteria (Table 1). The lesson material suits (min. three 
task slides) were independently evaluated by the first and second author (inter-rater 
reliability). 
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Table 1. Task evaluation grid 


1. Meaning versus form 

(yes) 1/0.5/0 (no) 

Comments/ 

Justifications 

Are pupils acting as language 
users (rather than learners)? 



Are pupils mainly concerned with 
expressing/comprehending meaning 
(not focusing on form)? 



2. Information gap 



Do pupils close an information gap as a 
result of communication taking place? 



Do pupils find out something they did not 
know as a result of the communication? 



3. Learner resources 



Has not all language needed for the 
task been specially pre-taught? 



Does the task allow learners to use language 
learnt on other, unrelated occasions? 



4. Result/outcome 



Do pupils use English to achieve an 
outcome (not as an end in itself)? 



Do pupils have to achieve a result to 
demonstrate task completion? 



5. Technology use 



Is the use of technology integral to the task 
design? (Is it impossible to do the task 
without technology, not just more difficult?) 



Does the technology have added 
pedagogical value (not just motivational)? 




3. Discussion 

With an M score of 6.375/10 (5Z)=1.398), it cannot be claimed that all participants 
were successful at applying the programme’s input in practice. Of the 14 IWB 
lesson designs, two were rated unsatisfactory, two achieved the highest score 
of 9/10. Zooming in on the task design criteria, the trainee teachers struggled 
most with the TBLT ‘Information gap’ element (No. 2 in the grid): utilising 
communication to close an information gap (M=0.429) and allowing pupils to 
find out something new (M=0.571). ‘Meaning vs form’ (No. 1) and ‘Learner 
resources’ (No. 3) were the aspects they performed best on. Having learners 
mainly concerned with expressing and comprehending meaning (instead of 
focusing on form) appears to have been easiest to achieve (M— 0.833). Discussing 
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further results would go beyond the scope of this short paper, but the study’s 
practice-based output allows for fine-tuning of the criteria (within the iTILT2 
project) so that researchers will have better tools to analyse the TBLT approach 
of (novice) teachers, and the teachers themselves a clearer idea of what sound 
TBLT requires. 

A Pearson’s r hypothesis test did not reveal a (significant) correlation between 
the IWB group assignment and the individual classic task design (r=-0.105, n=7, 
p=0.6084) that was to demonstrate causality between TBLT comprehension and 
task design quality. This does imply, however, that the pre-service teachers benefited 
from the collaborative aspect of the IWB assignment (and/or from the ‘IWB for 
TBLT’ programme itself) and - we would like to think - from the affordances of 
technology to facilitate meaningful, realistic tasks in class. 


4. Conclusions 

The effect of TBLT can be increased considerably, but besides specific affordances, 
using new technologies like IWBs also entails constraints. From our study and our 
broader experience with technology, we infer four hypotheses. 

1. Tasks should be made more motivating by focusing on their mental 
acceptability and students’ willingness to carry them out. Meaningfulness 
(‘What’s in it for me?’) and usefulness (‘What’s in it for others?’) are key 
concepts in this respect. 

2. Tasks should be seen within a wide range of possible activities, from 
simple drill-and-practice exercises to co-construction of knowledge. 
Bloom’s Digital Taxonomy (Churches, 2009), the SAMR model 
(Romrell, Kidder, & Wood, 2014) or 21st Century Skills can be inspiring 
in this respect. 

3. There is too much focus on the properties of the task as a product, and 
not enough on task design as a process: how to select and adapt tasks to the 
specific and variable context of language learners and teachers. 

4. Tasks should always be seen as hypotheses. The validation of these 
hypotheses should be carried out by comparing the expected outcome with 
the actual outcome. 
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Abstract. This paper assesses the efficiency of the ‘Language Immersion e-Course’ 
developed at the London School of Economics and Political Science (LSE) Language 
Centre. The new self-study revision e-course, promoting students’ proficiency 
in spoken and aural Russian through autonomous learning, is based on the Michel 
Thomas method, and is focused primarily on lexical work, which students commonly 
consider to be one of the biggest challenges in language studies. The course, targeted 
at the intennediate (A2/B1) level of proficiency in Russian (with a specific focus 
on language for Social Sciences) was incorporated into students’ guided revision 
programme. The package is downloadable as a mobile application offering more 
flexibility for the users. This paper focuses on the pedagogical evaluation of the project 
(through students’ feedback and their exam performance), and analyses the learning 
implications of such e-courses as a valuable alternative and added value to classroom 
teaching. Given that lexical command plays a fundamental role both in fluent language 
production (speaking and writing) and efficient comprehension (listening and reading), 
the paper asserts the benefits of such e-courses for blended learning programmes, as 
well as for improving overall efficiency of students’ second language acquisition. 

Keywords: mobile application, Michel Thomas method, lexical work, autonomous 
learning. 


1. introduction 

A new self-study revision e-course was designed to develop students’ proficiency in 
spoken and aural Russian and to enhance their skills as autonomous language learners. 
The Russian Language Course discussed here is offered to LSE undergraduates 
within their Degree programme. The project was based on the Michel Thomas 
communicative method (see below) and draws on several related areas of language, 
pedagogical research and practice. Firstly, it was designed to increase the number 
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of language immersion hours, especially during the Easter break in the lead-up to 
students’ examinations. The absence of language practice during the four-week break 
may impair students’ fluency and language command acquired over term time; this 
is largely the case for beginners/low intermediate level students, whose proficiency 
in Russian has not yet been consolidated by years of continuous tuition and practice. 

Secondly, the project addresses difficulties associated with aural and lexical work in 
language learning. These areas of language acquisition are traditionally perceived 
by students as the most problematic (Rivers, 1992), and require significantly more 
practice to reach the same level of mastery as other modules. The issue becomes of 
particular pedagogical relevance in light of the fact that listening comprehension 
plays a major role (40-50%) in the overall process of language communication 
(Gilman & Moody, 1984). 

Finally, the course reflects specialised Social Sciences focus of the LSE Language 
programme. The intention was to provide students with tailor-made language 
materials within a socio-political context (the relevant spectrum of topics is rare 
among commercial on-line materials), and to enhance their experience in language 
learning through a resource adaptable to the variety of learning abilities and 
individual needs. 


2. Method 

The project is grounded in the Michel Thomas method, aimed at developing 
cognitive fluency through oral and aural practice by way of contextual reiteration 
of vocabulary and linguistic structures (Solity, 2008; Woodsmall & Woodsmall, 
2008). The latter is combined with the ‘inductive’ mode of critical apprehension 
(grammatical concepts are derived from a series of examples rather than from 
traditionally ‘pre-packed’ explanations). The strength of the method lies in 
progressive accumulation of ready-to-use lexemes, allowing learners to retain 
vocabulary, while gaining a deeper understanding of how the language actually 
works. Every new lexical set is introduced topically within an exchange context. 
This, together with the interactive aspect (there is constant pressure to recall and 
reconstruct from the previously acquired lexical bank), provides an effective mode 
of multidimensional learning from internalising intonation and pronunciation to 
embedding contextual memory prompts. 

The unique feature of the course is its subject-specific content, purposely designed 
for the LSE Language for Social Sciences programme. The development of this 
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course ties in well with the general framework of applied research carried out by 
the Russian Section, which is focused on cognitive fluency study (Bershadsky, 
2012; Sobolev & Nesterova, 2013). 

The course was targeted at the intermediate (A2/B1) level of proficiency in Russian, 
and was incorporated into students’ guided revision programme outside term-time 
classroom teaching (a group of 12 students used the resources for a continuous 
period of four weeks). The course was available as a mobile application (iPhone/ 
iPad/android devices), so that students could have some extra flexibility for the 
hours spent on their daily language routine (a full written transcript of the recording 
was accessible on-line). 

The project’s learning outcome and pedagogical impact were evaluated in two ways: 
informally, through students’ feedback obtained through a short questionnaire; 
and formally, through students’ performance in the end of year examinations. 
The questionnaire was paper-based, and circulated to students taking the course 
before examination results were published, and thus functions as an arguably more 
accurate gauge of the e-course as preparation for the examination. 


3. Results and discussion 

The survey contained questions related to the academic values of the project: its 
pedagogical worth (i.e. increasing students’ confidence as language users) and 
presentation. Students rated each aspect on a scale of one to five (with five being 
the highest rating). The overall feedback was highly rewarding: all aspects of the 
project were rated over 80% positive by 92% of students. No negative aspects 
were specified. In their written comments, students specifically mentioned that 
the course was extremely helpful for the exams and increased their confidence 
as language users. The latter was particularly noticeable in oral examinations: 
according to the external examiner’s comments, students’ ability to take initiative 
in conversation was outstanding for an ab-initio level group. 

Students’ performance in exams was compared to their average Continuous 
Assessment (CA) grade throughout the year; this grade is based on weekly 
assignments in all four language skills: oral, listening, reading and writing. The 
cohort was a mixed ability group of students, who had started learning Russian ah 
initio at the beginning of the year (with A2/B1 exit level). The average CA grade for 
the group (74.2%) corresponds to the average CA grade recorded for the last five 
years, showing that this was not an exceptionally able group of Russian learners. 
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The standard of students’ performance in the exam was noticeably high: the average 
final grade was 2% higher than the CA grade obtained throughout the year. This 
was a positive improvement on the predicted result, reversing the trend for the last 
five years: the CA grade used to be 2% higher than the exam grade. 

The breakdown of exam results in four language skills is presented in Figure 1, 
showing manifest improvement in all modules as compared to previous years. 
Given that these results cannot be attributed to the exceptional linguistic ability of 
the learners, this allows us to link the higher level of students’ proficiency in Russian 
to the benefits of the revision e-course. Although it would perhaps be over-hasty 
to draw firm conclusions in this area on the strength of a single pilot exercise, the 
results indicate the key role of vocabulary work in advancing students’ proficiency 
in the second language. The better outcome in reading and writing as compared to 
listening can be attributed to the generally acknowledged fact that improving aural 
skills is one of the most difficult tasks for language learners and teachers alike 
(Rivers, 1992). 


Figure 1. The breakdown of students’ exam results in four language skills 
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4. Conclusions 

A new self-study downloadable revision e-course had a proven positive impact on 
students’ language learning experience and performance. Apart from a noticeable 
improvement in their competence in Russian, the course enhanced students’ 
transferable skills as autonomous learners and, through its routine mode of active 
exchange, increased their self-esteem as confident language users. As regards 
teaching practice, the use of mobile applications can provide a valuable model for 
the development of language packages in blended learning - a balanced mix of 
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traditional and digital technologies, which enhances the productiveness of language 
acquisition. The course can be easily expanded to supplement routine classroom 
teaching. Topically based modules can be created to enhance and develop students’ 
language skills throughout the year, increasing the number of contact hours of 
language immersion, ensuring the continuity of the learning cycle, and giving scope 
for certain activities to be ‘flipped’. The preparation of this particular e-course was 
definitely facilitated by access to the skills available from a Russian language team 
built up over many years, and with a proven track record shared by all its members. 
The members of staff involved were, overall, highly encouraged by the outcome of 
the exercise, and, more generally, LSE are already looking to replicate e-courses 
along these lines with other languages taught as part of undergraduate degrees. 
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Abstract. The time available for classroom language learning is often insufficient 
for attaining reasonable levels of proficiency in the target language. For this reason, 
optimising time in the classroom is contingent upon what students are able to do 
outside of class time. In this paper, we introduce Bande a Part, a mobile application 
(app) that uses music as a pedagogical tool, developed for learners of French as 
a second or foreign language. As an out-of-class tool, the proposed app has the 
potential to increase the quantity (and possibly the quality) of the exposure to the 
target language, thus addressing the time constraint mentioned above. Specifically, 
we describe the recent addition of grammatical information to the app, which is 
now tagged to individual songs. With this addition, songs can be better aligned with 
curricula and individual needs. Aligning the application to a curriculum helps bring 
continuity between the classroom and learning outside of the classroom. 

Keywords: French as a second language, mobile-assisted language learning, 
grammar. 


1. Introduction 

As any language learner knows, it is not difficult to find target language input 
online. Nevertheless, as one begins learning a new language, the majority of the 
available material is incomprehensible and is not appropriate to one’s level of 
proficiency. To demonstrate how access to these materials can be facilitated, we 
developed a mobile music application for L2 French learners called Bande a Part 
(BaP). This web-based application was realised by drawing on research on the 
effects ofL2 language input (and its relation to output and interaction; e.g. Nation, 
2013). BaP heeds Engh’s (2013) recommendation to incorporate music into 
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language learning, and adapts the concept of graded readers (wherein vocabulary 
is controlled in ‘grade’ levels to make content accessible to learners). This student- 
centred application allows learners to choose material based on a number of criteria 
which enable them to learn according to their interests and proficiency level, in an 
effort to extend learning beyond the classroom. 

During the pilot testing of the app, French teachers (and students) asked for the 
ability to choose songs based on grammatical features. Their rationale for this 
suggestion was to align the application with their current curriculum and to allow 
students to receive extra practice with the features with which they struggled. This 
echoes the principles outlined by Doughty and Long (2003), who recommend that 
new language learning technologies be aligned with L2 learning curricula and 
student needs. The current study reports these developments in the design of BaP in 
which songs are organised in terms of grammatical categories. Figure 1 illustrates 
the new version of the song selection database that displays the ‘Grammar’ column 
and some of the searchable criteria that learners can use to select music. 


Figure 1. BaP: song selection 


Search: 

Song 

Artist 

Country Of Origin 

Gender of Singer 

Genre 

Vocabulary 

Difficulty 

Grammar 

Est-que lu le sals? 

Les Chats Sauvages 

France 


Retro 

Easy 

1st/2nd person pronouns. Verbs in 1st/2nd 
person. Clitic pronouns 

Je Taime 

Frangoise Hardy 

France 

Female 

Retro 

Easy 


Je Le Savals 

Julie Doiron 


Female 

Indie 

Easy 

Adverbs, Island person pronouns. Verbs 
in 1st/2nd person 

Si Tu Es Un Homme 

Alizee 

France 

Female 

Pop 

Medium 

1st/2nd person pronouns, Auxiliary verbs 

In 1st/2nd person. Negation participle 'ne', 
Connector subordinate conjuctions 'si, 

Tous Les MSmes 

Stromae 

Belgium 

"" 

Rap 

Medium 

Number invariate nouns. Special 
adjectives In singular 

Lalsse Tomber Les Filles 

France Gall 

France 

Female 

Retro 

Medium 

Plural^ determiners. Special invariate 


In the next section, we introduce BaP and outline the procedures adopted for 
tagging the grammatical categories in the corpus. The method for creating the 
app and the grading of vocabulary have been reported in Sundberg and Cardoso 
(2015). 

2. BaP: the addition of grammatical categories 

BaP is a database of songs consisting of a variety of genres (so that learners can 
select songs according to their interests), and artists from a variety of regions (to 
expose students to different accents). Once the database was compiled and the 
lyrics analysed by frequency bands (for details about this process, see Sundberg & 
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Cardoso, 2015), videos were created and uploaded onto a website so that learners 
could access them via a mobile device or computer. 

To contextualise the current study, Figure 2 illustrates the interactive screen used 
by learners to play a song in BaP once they have made a selection. This interactive 
video-based interface allows learners to slow down the music, navigate at a phrase 
level to repeat troublesome lines, read along to the lyrics of the song and display 
a translation if they are struggling to understand a word or a sentence, in addition, 
textual enhancements are present to increase the saliency of language features (e.g. 
liaison, gender, the subjunctive form). 

Figure 2. BaP: the interface 



Ferme les^yeux donne-moi 
ta bouche 



For tagging the grammatical categories in the corpus, Open Xerox’s ‘Part of Speech 
Tagging (Standard)’ tool was used, which is part of their linguistic tools web app 
(Open Xerox, 2016). By ‘grammatical category’, we refer to the part of speech 
categories set out by Open Xerox, which include parts of speech as well as further 
delimitations such as number and person agreements. 

The grammar in the lyrical content of the songs was analysed in three ways with 
the goal of tagging each song with at least three prominent features. For the first 
analysis, the entire corpus was analysed as a whole. This enabled us to calculate the 
percentage at which each of the grammatical features occurred in the corpus. The 
percentage served as the average that each of the songs could later be compared to. 
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So, for example, in the corpus, adverbs made up 5.4% of the total words, whereas, 
in a particular song such as ‘Le Slow’ (by Granville), they made up 15% (a total 
of 42 adverbs in the song); nearly 10% more than the average, including all songs. 
By comparison, the song ‘Jeans Troues’, by the same artist, includes only three 
adverbs in the whole song (or 1.9% of that song’s grammatical content). Based on 
these results, we conclude that the song ‘Le Slow’ is a more fitting candidate for 
exposing learners to adverbs (and their positioning) in French. A song was tagged 
for a particular grammar feature only if that feature occurred 5% or more than 
in the corpus as a whole (the inclusion of less frequently occurring items would 
generate too many tags, diminishing the impact of the most frequently occurring 
grammatical features). 

One issue that arose was that certain parts of speech are more susceptible to 
variation between songs. For example, it is very unlikely that the conjunction que 
will appear 5% more in one song compared to another and so, using the above 
procedure, no song would be tagged as being a good exemplar for the conjunction. 
For that reason, we used a second procedure to analyse the grammar. For many of 
the categories that never varied by 5% or more, we tagged the top 10% of the songs 
with the highest percentage of a given feature. For example, the song ‘Si tu es un 
homme’ by Alizee contains the negative participle ne 3.7% more than the average 
and this turns out to be far more than what is typically found in the data set (only 
three of the total songs vary positively or negatively by more than 2% with this 
feature). 

The last way the grammar in the songs was analysed was by looking at the number 
of occurrences (rather than percentages) of the target grammatical feature. Songs 
differ considerably in length (total number of words), so a longer song could 
still have many instances of any one element without boosting the percentage - 
suggesting that it should be tagged with that feature. An example of this is found 
in the song ‘Les Passants’ by Zaz. This song includes 19 plural determiners, more 
than any other song in the corpus; however, due to its length, this does not account 
for 5% more than the average (it is close at 4.2%), nor place it in the top 10% 
when looking at plural determiners alone (there are other songs that have higher 
percentages). 


3. Discussion and concluding remarks 

The intent of this paper was to demonstrate how out-of-class, student-centred 
material such as BaP can be aligned with current curriculum with respect to 
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grammar in L2 French. To do so, we have provided users with practical and useful 
information about grammatical categories in songs in order to expand the means by 
which the learning process can be regulated. With ample material available online, 
music is but one form of input. A lot of potential exists for curating online material 
for learners according to established research. This can be done through flexible 
programs such as BaP, which have the potential to meet the needs of independent 
learners, and fulfill the curriculum requirements for language teachers. 

There are still some issues that will need to be addressed in future developments 
of the app, following usability tests. One of these concerns has to do with how the 
grammatical categories are displayed in the app. As illustrated in Figure 1, some 
of the information provided is complex and/or lengthy. A possible solution to this 
problem is to make the relevant and complex grammatical feature/s clickable or 
' liypcrl i nkcd ’ so that learners can access definitions or examples on their own. 
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for language teachers 
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Abstract. The starting point for this project was the question in how far a Computer- 
Assisted Language Learning (CALL) module in a Teaching English to Speakers 
of Other Languages (TESOL) course can bring the students up to the required 
level of being confident CALL users. The teachers’ part of the TESOL Technology 
Standards Framework was chosen as evidence for the level of training required. 
Each standard was first matched against the components of an existing CALL 
module. Standards that were not met were then filtered for achievability in a pre¬ 
service teacher training situation. Next, all remaining standards were examined to 
find out whether they could be incorporated into the module, either by modification 
of an existing element or the introduction of new elements. A second step involved 
the evaluation of components of the CALL course that did not seem to contribute to 
helping the students reach any of the technology standards. One of the goals of this 
procedure was to give more structure to the process of regular updates of the module 
content, beyond simply updating the software used in the module, and to allow for a 
more principled improvement of the module over the years. 

Keywords: teacher education, TESOL, technology standards framework, 
normalization of CALL. 


1. Introduction 

While computers of various types are increasingly common in classrooms, 
CALL itself cannot be said to be entirely normalized yet, partly because many 
language teachers are reluctant to use much technology in their classes. The need 
for more systematic integration of CALL in teacher training has been pointed 
out by Hubbard (2008) and He, and Puakpong, and Lian (2015), amongst others. 
Hong (2010) states that the aim of such training is teachers knowing about and 
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being confident with CALL in their classrooms, something that probably cannot 
be achieved with just a few workshops. Teachers, and also trainee teachers, vary 
widely not just in their knowledge of potential CALL tools, but also in their 
confidence and attitude towards them. O’Reilly (2016) attempts to address this 
kind of variation among teachers by a needs analysis in the form of a survey 
that includes a range of answers for a whole series of dimensions. If we only 
look at trainee teachers rather than in-service teachers, we might assume that 
these digital natives would be a more homogeneous group, but there is still 
considerable variation in their skills level. 


2. Method 

The starting point for this project was the question in how far a CALL module in 
an undergraduate TESOL/Applied Linguistics course (i.e. not an actual teacher 
training course) can bring the students up to the required level to give them the 
skills and the confidence to use CALL once they start teaching. A large proportion 
of the students go on to some form of teaching; some already have a CELTA. The 
module is based around a multimedia CALL project that the students create over 
the course of ten weeks, using either free or very commonly used software (mostly 
Microsoft PowerPoint, Google Forms, Hot Potatoes). 

The Technology Standards for Language Teachers (part of the TESOL Technology 
Standards Framework, Healey et al.. 2008) was chosen as evidence for the 
level of training required. The TESOL Technology Standards includes sets of 
standards for both learners and their teachers; here only the teachers’ set was 
considered. The teacher standards are structured into a basic and an expert level 
and have further specifications for various teaching contexts, e.g. English for 
Specific Purposes (ESP), young learners,and high-tech or low-tech classrooms 
(cf. Kessler, 2016 for a discussion of this set of standards). In a first instance, 
each standard was matched against one or more components of an existing 
CALL module. Standards that were not met were then filtered for achievability 
in a pre-service teacher training situation, and those that were deemed not to 
be achievable or relevant in the given context were eliminated. All remaining 
standards were then examined to find out whether they could be incorporated 
into the module, either by modification of an existing element or the introduction 
of new elements. A second step involved the evaluation of components of the 
CALL course that did not seem to contribute to helping the students reach any 
of the technology standards. One of the goals of this procedure was to give more 
structure to the process of regular updates of the module content, beyond simply 
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updating the software used in the module, and to allow for a more principled 
improvement of the module over the years. 

The given technological context was relatively high-resource and high-access; the 
course took place in a computer lab with internet access at a British university. 
Students also had access to networked PCs in the university library, and also 
typically their own laptops and smartphones. Resources going beyond this were 
limited however, and students would more likely use their mobile phones for 
recording their own video material than borrow a video camera. Table 1 gives an 
overview of the TESOL technology standards for teachers and whether each one 
was deemed to be met in the CALL module or not, followed by a brief comment. 
Only abbreviated titles are given for the individual goals; for the full version, along 
with examples and vignettes, see Healey at al. (2008). 


Table 1. Overview of standards (E: expert level) 


Goal 1 

Foundational 
knowledge & skills 

Met? 

Comment 

1.1 

Basics 

Yes 

Students normally come to the course with 
this level of knowledge already present. 

1.2 

Understand the range 

Yes 

Students have at least a basic knowledge 
and can easily deal with the extra width 
and depth as covered in the course. 

1.3 

Expand the 
knowledge base 

Yes 

Some of this standard is met via the 
lectures and the reading material, 
some via the group assignment. 

1.4 

Culture and ethics 

In 

part 

Much of this is covered in other courses 
and is not particularly specific to CALL. 

Goal 2 

Integration 



2.1 

Identify suitable 
technology 

Yes 

The assignment is used as a 
‘teaching context’ and students 
choose from technology presented 
in class or found elsewhere. 

2.2 

Integrate technology 

Yes 

An undergraduate programme for pre¬ 
service teachers allows for limited 
coverage of this standard, mainly 
through the group assignment. 

2.3 

Design tasks using 
technology 

Yes 

E: no 

The assignment is the main element 
to meet this standard, albeit to a 
surprisingly limited extent. The expert 
level can only be said to be met on one 
element due to time restrictions. 

2.4 

Use research findings 

In 

part 

E: no 

In a pre-service environment, the principles 
can be covered via the readings. The 
expert level standard is not achievable. 
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Goal 3 

Application in assessment 

3.1 

Evaluate and implement 

No 

Students experience these technologies 
from the learners’ perspective mainly. 

3.2 

Collect and analyse data 

No 

This is not achievable in a pre¬ 
service environment. 

3.3 

Evaluation 

No 

This is not achievable in a pre¬ 
service environment. 

Goal 4 

Technology for improvement 

4.1 

Contact and collaboration 

No 

Some of the students’ other courses 
cover some of these issues. 

4.2 

Reflection 

No 

This is not achievable in a pre¬ 
service environment. 

4.3 

Efficiency 

No 

This is not achievable in a pre¬ 
service environment. 


3. Discussion and conclusion 

No elements of the course were found that did not contribute is some way to 
help the students reach one of the technology standards, but the balance of 
elements in the course could be changed to bring it more in line with the set of 
standards. On the whole, it was surprising to the module coordinator how few 
of these standards occur in a semester-long CALL course. For the next student 
cohort, standard 2.3 in particular should receive more attention; while students 
will happily try out a variety of tools, their critical evaluation of these tools is 
often quite superficial. One reason for this relatively low coverage is clearly the 
limited amount of time available; the notional 200 hours of work for a student 
for a module with 25 contact hours do not allow for much more than a taste of 
CALL. 

The other important issue is the fact that the students by and large have no teaching 
experience and no simple access to learners, so a number of the standards are 
basically out of reach for them. While the standards are a useful element for 
curriculum planning, a further structuring into pre-service and in-service training 
could be helpful for teacher trainers in their endeavour to improve and update 
their courses. Kessler (2012) pointed out the need for teacher trainers to raise 
their language teacher trainees’ awareness of the complexities of CALL tools, 
while also showing them the potential such technologies hold, in order to avoid 
early disappointment when something goes wrong. In addition to the TESOL 
standards, this may be a good general guideline to follow when updating a 
module on CALL. 
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Mobile-assisted language learning 
community and culture in French-speaking 
Belgium: the teachers’ perspective 

Julie Van de Vyver 1 



Abstract. This paper focuses on the perceptions and uses of mobile technologies 
by 118 Belgian teachers in foreign language teaching and learning in secondary 
education. The purpose of the study is to analyze the teachers’ attitudes towards the 
use of mobile technologies in- and outside the classroom via an online questionnaire. 
The preliminary findings presented in this paper establish that the concept of a 
‘Mobile-Assisted Language Learning (MALL) community’ does not yet exist in 
our context as the use of mobile devices is still limited. Nevertheless, it can also be 
stated that teachers’ attitudes and behavioral intention towards the use of tablets are 
slightly more positive than towards the use of smartphones, and that a vast majority 
of the teachers are interested in being trained to MALL. 

Keywords: MALL, teacher education, attitudes, usage patterns. 


1. Introduction 

The Computer-Assisted Language Learning (CALL) culture has been developing 
for several decades thanks to individual initiatives, scientific research and reflective 
practices from CALL practitioners. New teaching designs have subsequently emerged 
- such as Puentedura’s (2013) SAMR model or Liu et al.’s (2014) TPACK model - 
and new tools have been created (e.g. interactive whiteboards, educational apps). 
Mobile learning in general, and MALL in particular, are more recent manifestations 
of CALL and before integrating the technology in Belgium, there is a need to observe 
and discuss the current situation (Davie, 2015) and the readiness to adopt these 
tools in education as was done in other contexts (Fujimoto, 2012 for the Australian 
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context and Pieri & Diamantini, 2014 for the Italian one). Several projects have been 
implemented in the Federation Wallonia-Brussels (FWB), which is, in short, the 
French-speaking part of Belgium. They include the Plan Cyberecole in 1999, Plan 
Cyberclasse in 2005, Ecole Numerique in 2011, and Plan du Numerique in 2015 
(see www.ecolenumerique.be for more details) and were meant to equip educational 
environments with, among others, computers and tablets. Surveys have then been 
regularly conducted to evaluate the access to technologies in our secondary schools 
(Agence wallonne des telecommunications, 2013). However, mobile technologies 
per se and their use have not yet been much investigated in this context. 


2. Method 

2.1. Design and distribution of the study 

This present study concentrates on the perceptions and uses of mobile technologies 
by teachers in language learning in the FWB. Data was collected through an 
online survey conducted in 2016 and distributed in schools via e-mail lists and 
social networks. 87 male teachers and 31 female teachers, who teach the last three 
years of secondary education, completed the 15-minute questionnaire in French. 
The survey, which is part of a wider project on the acceptance of technologies for 
language learning, sought to answer the following research questions: 

• When and how (often) do these teachers use their computer, tablet and 
smartphone for educational purposes? 

• What are the teachers’ attitudes towards the use of the tablet and the 
smartphone in foreign language learning? 

• What is the teachers’ behavioral intention of use of these mobile devices 
in their teaching? 

The questionnaire mainly consisted in closed questions with items based on Davis’s 
(1989) Technology Acceptance Model (TAM) and extended TAM categories 
(Davis, Bagozzi, & Warshaw, 1992) and used a Likert-scale response format. 
They addressed teachers’ perception of ease of use, usefulness and enjoyment of 
mobile technologies, viz. tablets and computers in language learning. Another set 
of questions included teachers’ behavioral intention to use these technologies in the 
classroom and their actual use of the system. 
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2.2. Participants’ profile 

Out of the 118 respondents, the vast majority teach English (n=101) and/or Dutch 
(n—80) while some others are German (n=ll), Italian (n=ll) or French (n=l) 
teachers. As illustrated in Table 1, they are aged between 21 and 59 with nearly 
two-thirds (64%) of them above 40, 24% aged between 31 and 40 and 12% aged 
between 21 and 30. 


Table 1. Age of the respondents 


Age range 

Frequency 

% 

21-30 

14 

12 

31-40 

28 

24 

41-50 

44 

37 

51-60 

32 

27 

Total 

118 

100 


The subjects come from nearly 60 schools throughout the federation. We collected 
4 to 35 answers per province, mainly from rather experienced teachers, which 
correlates with the participants’ age groups. Although all the respondents possess 
a computer, only 70% of them own a smartphone and 43% report having a tablet. 
Besides, 38% possess two devices out of the three aforementioned, and 37% own 
the three devices. 


3. Results 

3.1. Teachers’ educational uses of mobile technologies 

The teachers were asked to select their different types of use of the computer, tablet 
and smartphone. Illustrated in Table 2 are their educational uses of each device. We 
can see that these uses are quite limited on mobile technologies. Indeed, whereas 
82% of the computer users consult a translation dictionary on their computer, only 
34% of the tablet users use one on a tablet and 27% of the smartphone users check 
words on a translation dictionary on their phone. Similarly, most teachers use 
websites for language learning and teaching on their computer. Although the use of 
a school platform or Open Educational Resources (OERs) is not so common among 
teachers, it is more common on a computer than on mobile devices. Regarding the 
use of educational applications, which are only available on mobile devices, we 
can see that only 4 smartphone users report using them. 
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Table 2. Educational uses of the three devices 



Computer 

Tablet 

Smartphone 

Translation dictionaries 

82% 

34% 

27,50% 

Websites for language teachers 

76% 

2,50% 

10% 

Websites for language learning 

76% 

2,50% 

8% 

Use of school platform 

38% 

6% 

6% 

Use of OERs 

23% 

0% 

4% 

Use of educational apps 

N/A 

0% 

5% 

Total users 

118 

82 

51 


3.2. Teachers’ use of technology in the classroom 

The following set of questions dealt with the use of the three devices for language 
learning. According to the subjects, 83 teachers (70%) use the computer with their 
pupils during languages classes, among which 39 (33%) use it rarely, 33 (28%) use 
it sometimes and the remaining 11 (9%) from often to all the time. 

Regarding the use of mobile devices in the classroom, 18 teachers (15%) report 
using a tablet, among which 11 (9%) of them use it rarely. 20 teachers (16%) use a 
smartphone in the language classroom. 

3.3. Teachers’ perception of ease of use, usefulness 
and enjoyment of mobile devices 


In order to find out about teachers’ perceptions of the use of the mobile devices 
in language learning, the participants were asked to answer the following 
question using a seven-point Likert scale with 12 opposite adjectives (e.g. useful 
vs useless): “Using the tablet (Ql)/the smartphone (Q2) to learn languages in 
secondary education is according to you...”. 

Illustrated in Table 3 are the means obtained for each category of adjectives. 
These scores establish that the teachers’ Perceived Ease of Use (PEoU), Perceived 
Usefulness (PU) and Perceived Enjoyment (PE) are all slightly higher for the 
tablet than for the smartphone. However, the PU and PEoU results are quite 
close to the neutral position (4) and should therefore neither be considered as 
highly positive nor as highly negative perceptions. Furthermore, the only score 
below the neutral position (4) reflects the teachers’ perception of usefulness of 
the smartphone. 
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Table 3. PEoU, PE, and PU for mobile devices 


TPEoU 

4,32 

SPEoU 

4,28 

T PE 

5,1 

SPE 

4,88 

T PU 

4,29 

SPU 

3,86 


3.4. Teachers’ behavioral intention of use of mobile devices 

According to nearly all the participants (n=116), teachers should use mobile 
devices in language classes in secondary education. As shown in Figure 1, 56% 
(n—66) of them think that these devices should be used occasionally to sometimes 
and 42% (n=50) believe they should be used regularly to very often. Nevertheless, 
when asked about their wish to use a tablet or a smartphone in their classroom, 
about 50% of the respondents answer negatively. Still, 77% (n=91) of them are 
interested in some MALL training. 

Figure 1. Teachers’ opinion on the use of mobile devices in the language classroom 



4. Discussion and conclusions 

The results regarding the use of technologies by the teachers for educational 
purposes show that most activities are performed on computers as opposed to mobile 
technologies, which are used by only a third of the population, mainly for looking 
up words in a dictionary. As for the use of mobile technologies in the language 
classroom, less than 20% of the respondents report using a tablet or a smartphone 
in this context. With regards to the teachers’ attitudes towards the use of the tablet 
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and the smartphone in the classroom, the survey establishes that, although the 
perceptions of ease of use, usefulness and enjoyment of both devices are neither 
very positive nor very negative, the tablet receives slightly higher scores. According 
to the teachers, it is a more enjoyable, more useful and somewhat easier to use tool. 
Dealing with our last research question, the teachers show some inconsistency in 
their answers as the overwhelming majority stand for the use of mobile technologies 
in the language classroom and as, on the other hand, half of them do not wish to use 
tablets or smartphones in their classroom. Still, most of the subjects report being 
interested in knowing more about MALL. 

In conclusion, it seems important to take these perceptions into consideration when 
implementing MALL in the context. Although deeper analyses will be needed to 
detect the most influential factors that lead to the usage of the technology, it can 
already be stated that the use of MALL in schools is at an early stage of development 
in French-speaking Belgium and that we should develop the field of MALL in 
teacher education, taking the cultural specificities of the context into account. 
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Abstract. The paper describes initial efforts on creating a system for the automatic 
assessment of Swedish second language (L2) learner essays from two points of 
view: holistic evaluation of the reached level according to the Common European 
Framework of Reference (CEFR), and the lexical analysis of texts for receptive and 
productive vocabulary per CEFR level. We describe the data and resources that our 
experiments were based on, provide a short introduction to the algorithm for essay 
classification and experiment results, present the user interface we developed for 
testing new essays, and outline future work. 

Keywords: automatic online L2 essay classification, lexical complexity assessment, 
productive and receptive vocabulary by CEFR levels. 


1. introduction 

Learner essay grading presents a lot of challenges, especially in terms of manual 
assessment time and assessors’ qualification. Evaluating learner writing quality 
can be very time-consuming since it stretches along different linguistic dimensions 
and thus might need several iterations of re-reading. Human assessment is 
precise and reliable provided that assessors are well trained. However, their 
judgements may also be subject to different outside factors, such as hunger or a 
negative attitude to a learner. To avoid misjudgements and to ensure objectivity, 
certain institutions have started to complement human grading with automatic 
assessment as a more objective reference point, e.g. Educational Testing Services 
(Burstein & Chodorow, 2010). 
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Developing a data-driven Automatic Essay Grading (AEG) system is a non-trivial 
task which needs to rely on (1) data consisting of essays manually graded by human 
assessors, (2) a set of rules or specific features relevant for the assessment, and (3) 
a classification algorithm based on the example data provided and the specified 
features that can predict the grade or level of previously unseen essays. AEG tasks 
have been addressed previously in a number of projects, e.g. Hancke and Meurers 
(2013) for German, Burstein and Chodorow (2010) for English, and Vajjala and 
Loo (2014) for Estonian. For Swedish, Ostling, Smolentzov, Tyrefors Flinnerich, 
and Hoglin (2013) have looked at Swedish upper secondary school essays, i.e. first 
language (LI) learner essays, and evaluated them in terms of performance grades 
(pass with distinction, pass, fail). In contrast to them, our main aim has been to 
assess the reached proficiency levels in essays written by L2 learners of Swedish. 

The system presented here uses CEFR levels (Council of Europe, 2001). The CEFR 
framework has been selected since it is very influential in both Europe and outside 
with numerous projects targeting its interpretation (e.g. Hancke & Meurers, 2013; 
Vajjala & Loo, 2014), however, very little work has been done for CEFR-based L2 
Swedish. 


2. L2 essay classification 

2.1. Essay corpus 

The availability of data is critical for AEG experiments. Our experiments are 
based on SweLL (Volodina et al., 2016), a corpus consisting of L2 Swedish learner 
essays, linked to proficiency levels as defined by CEFR. Essays cover five of the 
six proficiency levels (see Table 1) with varying amounts of essays per level. 

All essays contain information on learners’ mother tongue(s), age, gender, 
education level, and at which CEFR level the essay is. Essays have been used 
to extract features based on available annotation, such as level, dictionary forms, 
word classes, syntactic annotation. 


Table 1. Overview of SweLL corpus 



Al 

A2 

B1 

B2 

Cl 

Unknown 

Total 

Nr essays 

16 

83 

75 

74 

89 

2 

339 

Nr tokens 

2 084 

18 349 

29 814 

32 691 

60 095 

360 

144 087 
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2.2. Feature selection 

Feature selection is the most important and time-consuming part of an AEG 
project. Features can be language independent, such as n-grams, sentence- and 
word-length, or language specific, such as out-of-vocabulary words (where 
vocabulary is defined as some lexicon or word list). Our experiments included an 
empiric analysis of data, the extraction of relevant features in machine learning 
experiments and experimentation with those to select the most predictive ones. 
Our complete set of 61 features (Pilan, Vajjala, & Volodina, forthcoming) extracted 
from the linguistic annotation available in SweLL include count-based, lexical, 
syntactic, morphological, and semantic features. 

2.3. Essay classification experiments and results 

Using SweLL as training data, we created a classification system which predicts 
which CEFR level the writer of an essay has performed at. We used the Sequential 
Minimal Optimization (SMO) machine learning algorithm available in WEKA 
(http://www.cs.waikato.ac.nz/~mFweka/), which based on the linguistic features 
observed in hand-annotated essays is able to learn how to automatically assign a 
CEFR level to a previously unseen essay. Table 2 presents results obtained using 
different types of features, where FI is the harmonic mean of precision and recall, 
and accuracy expresses the amount of correctly classified texts. The number of 
features per sub-group is also indicated since it may influence performance. 


Table 2. Classification results 



Nr features 

FI 

Accuracy (%) 

All 

61 

0.66 

66.96 

Count 

7 

0.45 

51.48 

Lexical 

11 

0.58 

59.52 

Morphological 

30 

0.53 

55.35 

Syntactic 

11 

0.51 

53.86 

Semantic 

2 

0.28 

36.90 


Our system with the complete feature set (ALL) classified essays with 67% 
accuracy, i.e. making correct assessments about seven out of ten times. Flowever, 
almost all (98.5%) classification errors were minor, within one CEFR level distance 
from the teacher-assigned level, a very encouraging residt which compares well to 
the human performance of 45.8% reported in Ostling et al. (2013) and systems 
for other languages using three times more annotated data, e.g. 61% for German 
(Hancke & Meurers, 2013) and 79% for Estonian (Vajjala & Loo, 2014). Lexical 
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features were the most informative, and the most useful single features included 
the number of tokens per CEFR level and word-list based frequency information. 


3. Lexical complexity analysis 

Both previous research and our experiments have indicated lexical features as 
one of the most predictive ones (Pilan et al., forthcoming). For this reason, we 
experimented with a stand-off (i.e. separate from essay classification in section 
2) lexical analysis of the essays for giving insights into the lexical complexity of 
a text, seen from receptive and productive perspectives. Similar efforts have been 
taken for other languages, e.g. English (http://www.englishprofile.org/wordlists/ 
text-inspector) and French (http://cental.uclouvain.be/flelex/), however, our 
resources allow us to identify receptive versus productive lexical items per level, 
whereas only productive vocabulary is targeted in the English system and only 
receptive in the French one. To be able to perform lexical analysis of texts, two 
lists have been employed: SVALex (Franyois, Volodina, Pilan, & Tack, 2016) and 
SweLL-list (Llozhi, 2016). 

SVALex is a frequency-based list derived from reading comprehension texts used 
for teaching CEFR courses, thus representing lexical items that L2 learners are 
exposed to while reading or listening, i.e. receptive vocabulary. The SweLL list 
is derived from the SweLL corpus, showing the distribution of lexical items over 
CEFR levels based on frequency information. Since SweLL-list items come from 
essays, they indicate the productive use of vocabulary. Each item in the two lists, 
a combination of a dictionary form (lemma) and parts of speech, has associated 
information on levels at which it appears. We preliminarily consider frequency 
peaks as an indication of the target level for that item. Refinement of the strategies 
for identifying target levels are under development. 

For analysis of lexical complexity, each word (i.e. its lemma in combination with 
its part of speech) in an essay is tested against the two resources and is associated 
with the CEFR level for receptive or productive knowledge. 


4. User interface 

The described work has resulted in an online service for testing arbitrary new 
essays written in Swedish. This is the first prototype of our system, where natural 
language processing tools are combined to deliver a user-friendly analysis of 


459 




Elena Volodina, lldiko Pilan, and David Alfter 


essays. Initially, essays undergo automatic linguistic analysis which generates 
dictionary forms, parts of speech and syntactic annotation. Then, depending upon 
user choices, a holistic assessment (i.e. reached CEFR level) as well as lexical 
analysis of an essay are generated using resources and techniques described above. 


Figure 1. User interface for L2 text classification 


Exercise Generator Hit-Ex Learner Corpora Editor Text evaluation Svenska English 



Language Acquisition Reusing Korp 

FllmeS hanlar om en KB . Han heter NN och han gilla dansar ballet ■ 
mycket. Nar han har idrott leklion J brukor han inte traifl ftoxning s| att H 
ballet med manga i nasta klassrummet. Han dansa mycket. var 
och nar han kan . Han| larare ger for han ett H §9 av ballet och han 
gommer den mellan for tvd medrasser | 


What do you want to 
assess? 0 

Text readability 


Learner essay 


Show all words of 
the following CEFR 
level(s) Q 

@ A1 ■ 

S A2 ■ 

£) B1 ■ 

□ B2 ■ 

□ Cl ■ 


Figure 1 shows available choices on the right, the feedback statement below the 
input and colour-coded lexical analysis of the pasted texts. Users have a choice to 
evaluate either L2 learner essays or reading comprehension texts. However, since 
classification of reading comprehension texts is outside the scope of this paper, 
we do not go into details. Words from the selected CEFR levels are highlighted 
showing receptive ones in a lighter color and productive ones in a darker color. 


The SweLL-based online system is not yet released for public use, however an 
experimental version is already available through the Swedish Language Bank at 
the university of Gothenburg, Sweden (https://spraakbanken.gu.se/larkalabb/). 


5. Concluding remarks 


Our classification experiments showed that, even though the presented system is 
an initial prototype and more work needs to be invested to make it fully functional 
and useful in the language learning context with regards to evaluation of learner- 
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written texts, essay classification results are promising. We found that considering 
the lexical dimension is particularly effective for CEFR level classification. Further 
work on refining the SweLL-AEG algorithm would include, among others, adding 
error annotation to the essays, linking error types to CEFR proficiency levels, and 
employing error types as a feature in our algorithm. Availability of error annotation 
would also facilitate a more instructive feedback to learners. 
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Abstract. This paper presents the prototype of a Mobile Language Learning 
Environment (MLLE) allowing learners of German at a Japanese university to map 
classroom learning content onto the pathways of their everyday lives, turning places 
they come by into mnemonic loci, and thus changing their daily commute into a 
learning trail. Even though the evaluation based on learners’ self-reports could not 
confirm the assumption that this type of MLLE supports the use of the loci method 
for all learners, it allows the conclusion that at least for some learners mnemonic 
mapping with mobile devices might lead to changes in learning awareness and an 
expansion of strategy knowledge. 

Keywords: MALL, memory strategies, context awareness, informal learning. 


1. Introduction 

Learners of German at Japanese universities face difficult learning conditions: 
they start late; class hours are few; their language learning biographies have been 
shaped by a school system mainly dedicated to making them pass entrance exams, 
leading to learning focussing on grammar rules, rote memorization of word lists 
and test taking strategies. A survey about learning habits conducted in the context 
of this study revealed low diversity of strategy use and showed that lots of learning 
happens on public transport, during often hour-long commutes. 
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The authors assume that, in order to foster successful learning in this context, a 
push for expanding learning times and trying out new learning approaches can 
be effective. They set out to support out-of-class learning, and to help learners 
create links between out-of-class learning and formal learning through mobile 
learning. 

it is often argued that mobile learning has the potential to bridge formal learning 
and informal learning experiences (Kukulska-Hulme & Sharpies, 2016). One of 
the toeholds that mobile devices offer for connecting our learners’ out-of-class 
experiences and their formal learning is context awareness, the focus on place 
(Kukulska-Hulme, 2010, p. 11). As learners move through the real world, learning 
opportunities can (be made to) arise that prompt learners to revisit what they learnt 
in the classroom. 

The authors have been exploring different ways of connecting places in German 
speaking countries and classroom learning contents, by designing MLLEs 
that supplied learners with learning materials according to (1) situations 
experienced in specific places (in public transport, in restaurants, etc.), offering 
on-the-spot help for oral interaction (Waragai, Ohta, Raindl, & Kurabayashi, 
2013), or (2) the places that learners had visited during the day, providing them 
with scaffolding for writing SNS-entries about their experiences (Waragai et 
ah, 2014). 

The MLLE 2d-radio presented in this paper follows a different approach to the 
notion of place: place does not figure as site of supported contact with the target 
language, but as a mnemonic locus. In the loci method, a mnemonic technique 
dating back to Greek and Roman orators and beyond, contents to be memorized 
is associated with places along a pathway and then depicted in an image (Moe & 
De Beni, 2005). 

Users of 2d-radio can register geolocational positions they come by regularly, 
such as train stations, on their mobile devices, and use them as loci for revision of 
classroom contents: they create images for each learning item and mentally link 
those images to loci on their pathway - and then review the items when travelling 
along the pathway again, or retrieve the memorized items when revisiting the 
different places in their minds. 

The authors developed, implemented and evaluated the MLLE in order to find 
out, if an MLLE linking places on learners’ commute to learning content can 
successfully support learners in applying the loci method. 
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2. Design of the learning environment 

2.1. The learning context 

2d-radio was designed as a platform for out-of-class learning, targeting participants 
of a German intensive course at Keio University, a 3-semester-program covering 
Common European Framework of Reference for Languages (CEFR) levels AO up 
to A2. Instruction in the course is based on video-centered courseware that presents 
interaction in situations closely related to students’ daily lives. Functions, grammar 
and vocabulary introduced in each chapter are summed up into seven to 16 key 
phrases excerpted from the video dialogues. 

2.2. Concept of the application 

Figure 1. Concept of the application 



A 



2d-radio was built on four principles: it (1) supports out-of-class reviewing of learning 
content, (2) offers learning incentives for commuting times, (3) encourages learners to 
link learning content to specific places and thus to try out a new mnemonic strategy (the 
survey of learning habits revealed that learners hardly employed memory strategies 
such as using sounds, images or emotions), and (4) focuses on aural input (Figure 1). 
The decision to provide aural input was informed by several considerations: the 
survey showed that learners tended to review key phrases by reading, pronouncing 
and writing rather than by listening; aural input might allow flexible use in different 
situations of commute; it can easily be linked to oral output; and there is evidence 
that the loci method leads to better memory results with aural than with written input 
because of the absence of visual interference (Comoldi & De Beni, 1991). 
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Figure 2. Functions of the application 



2.3. Functions of the application 

2d-radio was developed as a web-application. Users can place content onto 
locations on a map (Figure 2). They can post comments about the content 
(accessible by other users) and evaluate how well they have learnt each item by 
assessing retention with one out of three performance levels, which are represented 
by pins of different colors. 


3. Evaluation of a test run 

A two month test run was carried out in the spring semester 2016. For some chapters, 
the placement of the learning items was left to the learners; for other chapters, 
the administrator arranged the items on the maps. At the beginning of the term, 
2d-radio was presented to all 52 learners in the course. 15 of them showed interest 
in using the learning environment. Ten students took part in the online survey. It 
could not be reconstructed how many learners used 2d-radio in the first half of the 
test run; in the second half, when log data were collected, only three learners were 
found to have used the application. The log data of all three participants (subjects 
A, B and C) showed low average using times (ranging from ten to 21 minutes), 
even though subjects A and B had rather long commutes. 

At the end of the trial use, one of the authors interviewed the three subjects. The 
interviews were semi-structured, touched on the subjects’ general learning habits, 
with a focus on media use and strategies for reviewing classroom content, and on 
their use of the application. The interviews were partially transcribed and analysed 
exploratively. Major findings were: 
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1. Subjects A and B used 2d-mdio in public transport, but reported that 
they found it difficult to create mental links between places on their 
commute and learning items, stating that they did not know much about 
the places on their way to school, whereas subject C, who commutes by 
bicycle or walking, noted that she found it easy to link places along her 
path to key phrases. 

2. Subjects A and B described learning routines (such as reading, writing 
and using the textbook) they had developed and were not inclined to 
change. Subject C remarked she had used listening for reviewing for the 
first time and expressed surprise about how aspects of vocal expression 
remained in her memory together with the places and items. 

3. Subjects A and C preferred the learning items to be mapped by the 
administrator to having to do the mapping themselves. Subject C stated 
that she felt motivation when finding learning items in unexpected 
places. 

4. Subject A expressed tolerance about leisure and learning interlocking (e.g. 
by having her player shuffle between music and learning items). Subjects B 
and C stated that they preferred to keep both domains separate. At the same 
time, subject C noted that she appreciated that Id-radio provided her with an 
activity for her commute and thus prompted her to learn. 


4. Discussion and conclusion 

The first test run of Id-radio could not confirm that this type of MLLE can support 
learners in using the loci method successfully: too few learners used the application 
for too little time. The example of subject C though, who did report learning 
success and stated that she had discovered new learning approaches (reviewing 
by listening), might allow the conclusion that for some learners an MLLE like 
Id-radio can lead to broader strategy knowledge and changes in learning awareness 
(finding 2). 

Subject A and B did not perceive their mnemonic pathways as meaningful, whereas 
subject C did (finding 1). So, contrary to the assumption that Id-radio would work 
well for long commutes in a big urban conglomeration, the idea of meaningful 
pathways has to be reconsidered when designing similar MLLE. 
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The subjects showed different preferences as to the amount of control about the 
arrangement of learning content (finding 3). Whereas in the test run mapping was 
done either by learners or by the administrator, it seems advisable to offer learners 
both options at the same time and allow them to choose their preferred level of 
control. 

On a more general level, it could be reconfirmed that the modulation between 
leisure and learning is a sensitive issue for MLLE (finding 4). As already suggested 
by other researchers (Stockwell & Hubbard, 2013, p. 9), providing learners with 
control over how much they want to be pushed for learning might be a solution to 
this problem. 

The conclusions that can be drawn from the evaluation of the first test run, based on 
data of only three subjects, are certainly limited. They do, however, allow insight 
into factors to consider when working with mnemonic mapping on mobile devices. 
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Abstract. Many Computer Assisted Language Learning (CALL) innovations mainly 
apply to the Most Commonly Taught Languages (MCTLs), especially English. 
Recent manifestations of CALL for MCTLs such as corpora, Mobile Assisted 
Language Learning (MALL) and Massively Open Online Courses (MOOCs) are 
found less frequently in the world of Less Commonly Taught Languages (LCTLs). 
While some resources exist, there is not the range and variety of CALL resources 
available for these languages compared with the MCTLs. The vast majority of 
CALL literature refers to learning English in many different contexts and there is 
a limited amount of publications on LCLTs in the CALL domain. There are many 
reasons for this, including economic, political, cultural and historical ones as well 
as the fact that English is the de facto global lingua franca at the moment. It is 
important that CALL researchers working with LCTLs utilise the knowledge gained 
from CALL for the MCLTs. CALL researchers working with LCTLs can also learn 
from other LCTL CALL researchers and aim to be pragmatic and efficient when 
designing, developing and deploying CALL resources for learners. 

Keywords: CALL, less commonly taught languages, CALL challenges. 


1. Introduction 

Most of the recent developments in CALL mainly apply to MCTLs, especially 
English (Gamper & Knapp, 2002). Indeed, most of the presentations at CALL 
related conferences and journals report on CALL research for English. This is to be 
expected as English is by far the most popular language for learners to study due to its 
prominence as a language of global communication (Nunan, 2001). The popularity 
of languages for learners is influenced by a variety of factors, including how useful 
it will be for learners, how potentially beneficial it will be for their career and if it is 
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relevant to them for cultural or religious reasons. The term LCTLs (CARLA, 2016) 
refers to languages that are not the most commonly studied in a particular region 
or country. Languages such as French, German and Spanish are also considered 
MCTLs, although the classification can vary depending on geographical location. For 
example, from a European perspective, French, German and Spanish are considered 
MCTLs while Chinese is not. However, Chinese could be considered as a MCTL in 
the Asian and Oceania contexts and is certainly not a ‘lesser used’ language. 


2. CALL and LCTLs 

The list of recent and not so recent manifestations of CALL such as the use of 
corpora, MALL, MOOCs and telecollaboration in CALL (Beatty, 2013) are found 
less frequently in the world of LCTLs. It is easy to see why this might be the case 
as CALL development is difficult (Ward, 2015). With telecollaboration, at least one 
group, but preferably both groups, of participants have to be studying or have the 
ability to use the languages involved in the telecollaboration (e.g. English-French). 
For LCTLs it can be difficult to find matching language pairs of L1-L2 speakers for 
unusual combinations of LCTLs (e.g. Polish-Arabic learners). 

Many of the LCTLs are under-served by CALL resources and artefacts. In many cases, 
the knowledge of the worldwide CALL community has not spread out to researchers 
and teachers working in LCTLs and this is a pity as sometimes mistakes made in 
the MCTL context is repeated in the LCTL one. It takes time for the normalisation 
of CALL to occur and often the teachers and learners of LCTLs go through the 
(potentially painful) CALL normalisation cycle rather than avoiding pitfalls and 
arriving at normalisation quicker. Lack of awareness of strategies that have been 
successful in the MCTL context mean that this knowledge is not leveraged in the 
LCTL context. Sometimes the CALL assessment developers did not even speak the 
language for which they were developing resources (Ryan & Brunfaut, forthcoming). 
Godwin-Jones (2013) provides a good overview of technology and LCTLs. 


3. Extra CALL challenges for LCTLs 

There are several extra CALL challenges for LCTLs - these include motivation, 
limited access to suitable resources and pedagogical issues. Motivation is very 
important in the language learning context and perhaps even more so in the LCTL 
context. There are several extrinsic motivational reasons for learning an MCLT (e.g. 
potential economic benefits) but perhaps fewer for LCTLs. Some learners learn an 
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LCTL for pragmatic reasons, (e.g if you are living in the Czech Republic it is 
useful to learn Czech). Some learners learn an LCTL for heritage reasons, perhaps 
as adults or ‘encouraged’ by their parents (e.g. children of Greek heritage learning 
Greek in the UK). However, learners of an LCTL may need more motivational help 
if there is a smaller pool of peer learners for them to interact with and learn from 
(e.g. Japanese students learning Russian). 

With the advent of the internet, in theory, learners of an LCTL can also have 
access to a wide range of written, spoken and video resources in the target learning 
language. However, the mere existence of these materials does not imply that they 
are useful for language learners if they are too advanced for the learner or outside 
the learner’s zone of proximal development (Vygotsky, 1987). The materials need 
to be filtered and adapted to the learner’s needs. Learners whose L1 is written using 
a Latin or extended Latin alphabet often learn a new language using a Romanised 
version of that language and this can hinder their language learning progress 
(Reichelt, 2011). Van Aacken (1999) reports on the difficulties learners have with 
character-based languages. Japanese is one of the most spoken languages in the 
world and Japanese has overtaken German as the third most used language on 
the web (W3Techs, 2016). However, this does not automatically imply that it is 
useful for learners. For example, if a learner of Japanese is learning the language 
using romaji, the application of the Latin script to write Japanese, material written 
in kanji, hiragana and katakana will be unintelligible to the learner. For MCTLs, 
especially English, there is a wealth of pedagogical knowledge on how to teach 
the language, including how to teach to different groups of LI learners. However, 
there is a lot less research into the pedagogical issues involved in teaching many 
of the LCTLs. For some languages, e.g. Russian (Rodgers, 1967), there is a history 
of research into the difficulties students face when learning the language, but 
for others there are gaps. For example, what are the different challenges faced 
by LI Greek speakers compared with LI Thai speakers when learning Finnish? 
CALL design should draw on second language acquisition as well as language 
specific acquisition research in the case of LCTLs, as that research may not be very 
extensive and this could hamper the design of good CALL resources. 


4. Examples of LCTLs 

Arabic, Irish and Nawat are three LCTLs with different profiles and challenges. 
There are approximately 400 million Arabic speakers, and yet, until recently, it was 
an LCTL. Recent geo-political events have seen in increase in student numbers. 
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Learners of Arabic face challenges when learning to read and write in Arabic 
(Aliakbari, 2002). They often learn the language with short vowels marked by 
diacritics which are generally not used in written texts for native speakers and 
this can make it challenging for these learners to read authentic materials. Arabic 
is an example of a language with a large number of speakers that does not have 
the corresponding quantity of CALL resources available to learners. 

Irish is one of the two official languages in Ireland, the other one being English. 
English, however, is the LI of the vast majority of the population. Most of the 
teachers are L2 speakers and there are continued improvements in the pedagogy 
of Irish. There are some high quality CALL resources for Irish (e.g. Abair, 2016; 
Gramadoir: a grammar-checking framework, Scanned, 2008) but there is a lack 
of awareness amongst learners about their existence. Other CALL resources are 
aimed at linguists or may be developed by enthusiasts (and may contain errors) 
and are thus unsuitable for learners. 

Nawat is an Endangered Language (EL) spoken in Western El Salvador. There 
are approximately 150 remaining LI speakers. In recent years, there have been 
some CALL resources available for the language, but there are either fairly basic 
(Ward, 2001) or comprehensive (King, 2016) but lack interactivity. However, 
even though the resources are basic, they are of use to learners. Nawat is an 
example of an extremely EL that shares many characteristics with other ELs 
(limited number of native speakers, mainly elderly in poor circumstances) but 
has managed to develop CALL resources that can provide a starting point for 
other CALL and non-technological resources. 


5. Conclusions 

There are fewer CALL resources available for LCTLs compared with the MCTLs, 
one reason, as suggested by Wang (2009), might be related to the smaller pool 
of expertise available to LCTL CALL researchers. The CALL community can 
liaise with university teaching departments and teacher training colleges to make 
the future generation of teachers aware of CALL and how it can help in the 
learning process of LCTLs. It may seem that the difficulties may preclude the 
development of CALL resources for LCTLs, and there is no denying that it is 
more challenging in the LCLTs context. However, there are examples of CALL 
resources for LCTLs that can provide inspiration for LCTL CALL researchers, 
for example for Icelandic (IcelandicOnline, 2014) and Dutch (Rubens, 2014). 
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While such resources may lack the coverage and depth of other CALL artefacts, 
they can provide valuable resources for language learners. 
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Abstract. The orthographical depth of a language impacts on a learner’s ability to 
learn a language (Katz & Frost, 1992). If it is easier for learners to read the language as 
it is written, it will make the learning process easier. One way to address the problem of 
orthographically deep or opaque languages where the pronunciation is not very easy to 
determine is to demystify its pronunciation by using animation. This involves showing 
learners graphically how a combination of certain letters or diacritics produces a 
particular sound. This is particularly useful when the combination is different to what 
might be expected given the learner’s knowledge of how those letters or symbols 
sound individually. This is also important when two orthography systems may appear 
similar on a superficial level but are actually different. This paperprovides an overview 
of the animation component of the CALLIPSO system - a CALL resource for Irish 
orthography and pronunciation. Irish uses the same letters as the English alphabet but 
there are differences in the letter-sound correspondences. In the animation component, 
words are passed to the animation tool which demonstrates how each combination 
of letters gives rise to the overall pronunciation of the word. The tool is language 
independent and can be used for languages other than Irish. 

Keywords: orthography, pronunciation, animation, Irish. 


1. introduction 

Languages have different levels of depth or transparency; this refers to the degree to 
which the written language follows a one-to-one letter-phoneme correspondence. The 
orthographical depth of a language impacts on the learners’ ability to learn as well as 
their motivation. For example, in terms of a beginner’s ability to read and pronounce 
words in a language, an orthographically shallow (or transparent) language like 
Spanish is less challenging than an orthographically deep (or opaque) language such 
as English. For instance, learners with a knowledge of the Latin alphabet can give 
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at least an approximate pronunciation of Spanish even if they cannot understand 
the language. However, in the case of orthographically deep languages, learners can 
struggle to read words and this can lower their motivation levels. Orthographically 
shallow languages include Spanish, Italian and Finnish, whereas English, French and 
Hungarian are considered to have deep orthographies (Katz & Frost, 1992). 

Irish is the official first language of Ireland, but the vast majority of the population 
are LI English speakers. Most learners of Irish are compulsory learners as Irish 
is a core subject on the national curriculum. Motivation is especially important 
for compulsory learners who have to learn the language, as opposed to voluntary 
learners who choose to learn the language. 

Animation is an approach to demystify the pronunciation of a language. This involves 
graphically showing learners how a combination of certain letters or diacritics 
produces a sound combination. This is particularly useful when the combination is 
different to what might be expected given the learner’s knowledge of what those letters 
or diacritics sound like individually. For example, in English the combination ‘th’ 
sounds different to that what a learner might expect when a ‘t’ and a ‘h’ are combined, 
based on their sound as standalone letters. This is particularly important when two 
orthography systems may appear similar superficially but are actually different. 

Animation has been used in many domains for teaching and learning purposes 
(Ainsworth, 2008). Animation is useful for showing learners the transitions from 
one state to another and has been used in medical learning for many years (Grange, 
Bunker, & Cooper, 1997), but was not used extensively in the area of language 
learning, though there are many potential uses in the language learning context, 
such as showing word formation in morphologically rich languages or sentence 
structures in languages with different types of word order. Research in the area of 
visualisation and learning suggests that key pieces of past information should be 
visible to the learner and that users can control the speed of animation, although the 
issue of potential cognitive overload has to be taken into consideration. 


2. Method 

2.1. Overview of Irish orthography and pronunciation 

An animation component has been added to the CALLIPSO system (CALLIPSO, 
2016), which is a CALL resource for Irish orthography and pronunciation. Irish 
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uses the same letters as the English alphabet, with the letters ‘j, k, q, v, w, x, y, 
z’ only found in loanwords. However, there are differences in the letter-sound 
correspondences. Vowels present a particular challenge for LI English learners 
of Irish, that is, the vast majority of Irish learners. They often ignore the accent 
and pronounce the letters the same way as its corresponding non-accented vowel, 
in the animation component, annotated words are passed to the animation tool 
which demonstrates to the learner how each combination of letters gives rise to 
the overall pronunciation of the word. For example, the popular Irish first name 
Sean is pronounced Shawn [f a: m], but ab-initio learners may pronounce it as 
Say-an [sei- sen]. The animation tool explains the correct pronunciation of the 
word as a series of steps. Firstly, the learner is shown that ‘a’ is the key vowel 
to pronounce and that the other vowels are ignored. Then the tool explains that 
‘a’ has an ‘aw’ [a:] (as in ‘raw’) sound. The ‘s + e’ combination means that the 
‘s’ is pronounced as ‘sh’ [/]. At the end of the animation process, the learner can 
see the steps involved in arriving at the correct pronunciation of the word. The 
tool uses a combination of colours and movements to demonstrate these steps 
(see Figure 1). 

Figure 1. Screenshot of the animation of ‘Sean’ 


Se an 

Sh 


3. Discussion 

From a pedagogical perspective, some would question the synthetic phonics 
approach to teaching orthography and pronunciation (see Torgerson, Brooks, & 
Hall, 2006 for an overview of analytic and synthetic phonics). However, a similar 
approach has been used for teaching English to young L1 learners and it has been 
quite successful (Johnston & Watson, 2005). Children can pronounce previously 
unseen words comfortably and feel more confident in their reading. The CALLIPSO 
animated visualisation tool was originally designed for autonomous adult learners 
- with two specific groups in mind. The first group consists of parents of children 
learning Irish in school. Most parents will have studied Irish themselves in school, 
but a large cohort would have limited mastery of the language (e.g. immigrant 
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parents who have never studied Irish). Given that Irish is a compulsory subject 
in primary and secondary schools in Ireland, parents may struggle while helping 
their children with their Irish homework - especially when checking their spelling 
and reading skills. A parent cannot ask a child to spell a word such as ‘teach’ 
(house) if s/he pronounces it like the English word teach as opposed to the correct 
pronunciation [P a x]. 

The second group of learners consists of trainee teachers. Hickey and Stenson 
(2011) highlighted the need for a systematic approach to the teaching of Irish 
orthography. They argued that children struggled with reading in Irish because they 
did not know the rules of Irish pronunciation and there was an incorrect transfer 
from English, the LI of the vast majority of the learners. They did not know the 
rules because they were not taught to them. This was because the teachers were not 
explicitly taught the rules themselves, which in part may be due to the fact that the 
rules were never fully defined. Hickey and Stenson (2011) have worked to address 
this issue and have published the rules of Irish pronunciation, which is indubitably 
a complex area. Ongoing research is required, but their work to date provides a 
basis for the tool discussed in this paper, which could be used by trainee teachers 
themselves to ‘confirm’ their intuitions about Irish pronunciation or as a way of 
familiarising themselves with the patterns without having to expose their lack of 
knowledge to their peers or lecturers. 


4. Conclusions 

In recent years, research in CALL has tended to focus on Web 2.0 resources such 
as wikis, blogs and mobile learning. These resources could be classified as CALL 
tools on Levy’s (1997) CALL tool-tutor spectrum. They are computer-based tools 
that facilitate the teaching and learning of a language, but were not specifically 
designed for the purpose of language learning. The development of CALL specific 
artefacts, such as the CALLIPSO animated visualisation tool presented in this 
paper, is difficult and requires more time and resources than using an already 
existing technology, which is perhaps why there are generally less reported on in 
the CALL literature. However, there is room and a need for such resources. It is 
important that such resources are built using good software engineering techniques 
and incorporate reusability and sustainability concepts in their design to try to 
ensure that the resources can be used in other contexts and with other languages 
where possible, as in the case of the CALLIPSO animated visualisation tool, which 
can be used for languages other than Irish. 
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Abstract. Data-Driven Learning (DDL), in which learners “confront [themselves] 
directly with the corpus data” (Johns, 2002, p. 108), has shown to be effective in 
collocation learning in L2 writing. Nevertheless, there have been only few research 
studies of this type examining the relationship between English proficiency and 
corpus consultation. The current study intends to fill the gap by investigating 
how 140 learners of three different levels of English proficiency from Taiwan 
utilized Corpus of Contemporary American English (COCA) to correct eight 
different types of collocation errors adapted from their writing. Data was obtained 
from three aspects: learners’ collocation performance, learners’ COCA use, and 
learners’ evaluation toward COCA. A mixed-methods approach that included 
quantitative statistics and qualitative interviews was used. The results showed 
that even though learners of higher English proficiency performed better when 
using corpus, learners across all proficiency levels have improved collocation 
performance by 30%. Nevertheless, even though lower proficiency learners have 
received the same amount of assistance from corpus consultation, they did not 
think corpus as helpful as their higher proficiency fellows did. Teachers should 
not restrict the use of corpus to higher proficiency learners only because lower 
proficiency can also benefit from corpus use. 

Keywords: data-driven learning, L2 writing, corpus linguistics, collocation 
teaching, collocation learning. 
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1. Introduction 

DDL, originated from Johns (1990), in which learners approach linguistic data and 
induce patterns, has shown to be effective in collocation learning. Learners are 
able to consult a corpus, induce patterns, and correct collocation errors in their L2 
writing (e.g. Kennedy & Miceli, 2010; O’Sullivan & Chambers, 2006). While most 
researchers have argued that student-led corpus consultation can benefit advanced 
learners the most (Lin, forthcoming; O’Sullivan & Chambers, 2006), there has 
been little empirical evidence to support that claim (e.g. Boulton, 2009; Tono, 
Satake, & Miura, 2014). 

The current study intends to fill the gap by investigating how 140 learners of three 
different levels of English proficiency from Taiwan utilized COCA to correct eight 
collocation errors adapted from their writing. The research questions addressed are 
as follows: 

• How are the collocations enhanced after learners of three different levels of 
English proficiency consult COCA? 

• How do learners of three different English proficiency levels utilize COCA? 

• How do the students reflect on their COCA use? 

2. Method 


2.1. Participants 

The participants were non-native English speakers whose first language was 
Mandarin Chinese. Before taking part, the students had learned English for about 
eight to ten years, and their English proficiency levels spanned mostly the B1 
to B2 levels in the Common European Framework of Reference for language 
(CEFR). Students were divided into three levels as Group A (46 students, lower- 
intermediate level, B1 in the CEFR), Group B (47 students, intermediate level, 
B1+ in the CEFR) and Group C (47 students, upper-intermediate level, B2 in the 
CEFR). 

2.2. Research instrument and materials 

First, after the corpus tutorial and collocation instruction, learners completed the 
paper-based test in which they corrected eight collocation errors and provided 
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three correct answers for each error. Table 1 shows the eight collocation errors 
adapted from their writing and were chosen based on three sets of variables: 
LI congruency, level of difficulty, adjective+noun collocation and verb+noun 
collocation (e.g. Nesselhauf, 2003; Sun & Wang, 2003). Learners were not allowed 
to use any reference tools, which helps researchers to evaluate their original 
collocation knowledge. Afterwards, learners completed the COCA-based test, in 
which they corrected the same eight collocation errors by consulting COCA. In 
the study, learners used the ‘LIST’ function of COCA which showed the 100 most 
frequent collocates of the searched word. Learners were allowed to check other 
reference tools such as dictionaries, and they reported how many collocates 
they had clicked when checking COCA LIST functions. Learners completed the 
questionnaire regarding their corpus use after the COCA-based test. Ten students 
from three proficiency levels out of 140 subjects were chosen to videotape their 
corpus consultation and be interviewed at the end. 


Table 1. Eight collocation errors in the paper-based and COCA-based tests 



Collocation errors and 
three sample answers 

Verb+noun 
collocation or 
adjective+noun 
collocation 

Easy or 
difficult 
collocation 

LI congruency 

Ql. 

*tall salary :high, good, nice 

Adj.+noun 

Easy 

Li congruent 

Q2. 

*nroduce monev: 
make, earn, get 

Verb +noun 

Easy 

Li congruent 

Q3. 

*aDDrom'iate reason : legitimate, 
justifiable, compelling 

Adj.+noun 

Difficult 

Li incongruent 

Q4. 

*destrov attempt 
:defeat, foil, thwart 

Verb +noun 

Difficult 

Li incongruent 

Q5. 

*good desire: genuine, 
sincere, real 

Adj.+noun 

Easy 

Li incongruent 

Q6. 

*talk concern: express, 
show, convey 

Verb +noun 

Easy 

Li incongruent 

Q7. 

*unsatisfving desire : 
insatiable, unquenchable, 
overwhelming 

Adj.+noun 

Difficult 

Li congruent 

Q8. 

*cancel taxes : reduce, 
eliminate, abate 

Verb +noun 

Difficult 

Li congruent 


2.3. Data analysis 

First, the scores from both paper-based and COCA-based tests were analyzed 
using Stata’s descriptive statistics and a regression analysis to investigate the 
differences in the learners’ scores to answer research question one about learners’ 
performance and improvement in collocation knowledge. To answer research 
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question two regarding subjects’ COCA use, the use record from the 140 subjects, 
regarding the number of collocates they had clicked on in COCA, was analyzed 
by using descriptive statistics and a regression analysis in Stata to see how the 
number of collocates checked on the COCA LIST correlated with learners’ 
performance and improvement. Also, the videotaped videos and interview were 
analyzed qualitatively to understand the qualitative corpus behavior. In addition, 
the third question regarding learners’ attitudes toward corpus use was answered by 
analyzing questionnaire results and interview results. 


3. Discussion 

In total, 140 subjects corrected eight collocation mistakes in the paper-based and 
COCA-based tests, so in total, 1120 question hits were produced in each test. 
First, as shown in Table 2, subjects of higher proficiency have better collocation 
performance in the COCA-based test (Chan & Liou, 2005). Likewise, when 
learners utilize corpus to learn lexico-grammatical patterns, advanced learners 
perform the best (e.g. Johns, 1991; Lin, forthcoming). 

The current study further shows that the key point which makes learners of higher 
proficiency level outperform learners of lower proficiency levels is their better 
analytical and linguistic skills, rather than the better query skills (e.g. O’Sullivan 
& Chambers, 2006) or more corpus searches, because the behavior log showed 
that learners of all proficiency levels had no problem conducting corpus query 
and the frequency of corpus consultation does not differ among learners of 
different proficiency levels. 

Nevertheless, Table 2 also indicates that although learners of higher English 
proficiency outperformed learners of lower English proficiency in the COCA- 
based test, learners of all three proficiency levels improved the same amount in 
collocation by 30%. This shows that to assist learners of lower proficiency in 
DDL, student-led corpus consultation can be made easier through the following 
ways, such as giving learners access to a dictionary, providing sufficient corpus 
training (e.g. Kennedy & Miceli, 2010) and offering adequate teacher support 
such as underlining the errors (e.g. Mueller & Jacobsen, 2015; Tono et al., 2014) 
to help them conquer the difficulties in corpus consultation, such as inadequate 
skills in corpus query (e.g. Charles, 2011) and unfamiliar vocabulary and 
grammar in concordance lines (e.g. Chang, 2014), as the questionnaire data also 
showed that learners of lower proficiency did not think corpus use more difficult 
compared with their high proficiency classmates in the current study. 
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Nonetheless, even though subjects of lower English proficiency improved the 
same amount compared to the higher proficiency fellows, they gave corpus use 
lower evaluation compared with learners of higher proficiency. This also aligns 
with previous studies that except for advanced learners in Yoon and Hirvela (2004) 
who showed lower motivation toward corpus use, learners of higher proficiency 
generally showed more positive feedback to DDL compared to subjects of lower 
proficiency (O’Sullivan & Chambers, 2006; Tono et al., 2014). 


Table 2. Distribution of number and percentage of answers from subjects of 
various levels in the paper-based and COCA-based test 



Performance 

Group A 

Paper-based 

124 (33.96%) 

COCA-based 

240 (65.28%) 

Improvement 

116(31.32%) 

Group B 

Paper-based 

168 (44.7%) 

COCA-based 

285 (76.1%) 

Improvement 

117(31.4%) 

Group C 

Paper-based 

173 (46.88%) 

COCA-based 

293 (77.97%) 

Improvement 

120 (31.09%) 


4. Conclusions 

This paper showed that corpus consultation is beneficial for learners’ collocation 
enhancement, for both higher and lower proficiency learners, because learners 
of low proficiency have improved the similar amount as their fellows of higher 
English proficiency; but they were not aware of the efficacy corpus use has brought 
to them, as their evaluation toward the utility of COCA was statistically lower. This 
can be implied rather than restricting the corpus consultation use to learners with 
high English proficiency, as many researchers have suggested, teachers should, 
instead, be more open-minded about allowing all learners with different levels of 
English proficiency to obtain assistance from this resource. 
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Abstract. This study presents the way Parmaxi and Zaphiris’s (2015) social 
constructionist framework was used in order to teach and learn vocabulary in an 
Italian for Specific Academic Purposes (ISAP) tertiary course. The participants 
(beginner students) were guided to build in groups an artifact, i.e a specific academic 
vocabulary collection. To do so, they used Quizlet; this online learning tool allows 
the creation of digital artifacts, such as vocabulary flashcards, games and quizzes, 
and the sharing of the collections created. The purpose of the creation of the 
artifact was the learning and sharing of vocabulary in Italian used in the specific 
area of the students’ university fields of study. The data revealed that the social 
constructionist approach facilitated a more engaged and motivating attitude towards 
learning, allowing students to work constructively and collaboratively and share 
their knowledge with the use of new technologies. 

Keywords: vocabulary, Italian for specific purposes, constructionism, Quizlet. 


1. introduction 

Constructionism is a theory of learning, teaching and design which supports that 
knowledge is better gained when students construct it by themselves while they 
construct artifacts that can be shared and probed to the world. The student activities 
were framed according to a social constructionist framework which highlights three 
important activities: the exploration of ideas, the construction of an artifact and the 
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evaluation of an artifact (see Parmaxi et al., 2013; Parmaxi & Zaphiris, 2014, 2015; 
Parmaxi, Zaphiris, & Ioannou, 2016). In this study, this triptych was used for the 
group and collaborative construction of an artifact, an 1SAP vocabulary collection, 
with the use of Quizlet for the learning of vocabulary in a mixed fields class. Quizlet 
is an online learning environment as well as a mobile application which permits 
the creation of vocabulary, flashcards, games and quizzes and the sharing (through 
Facebook or other applications) of the collections created by the users. 


2. Method 

In this study a qualitative approach was adopted in order to observe the use of 
Quizlet under the social constructionist approach. The main research question that 
guides this study is: Flow a social constructionist approach can guide the use of 
technology, in this case Quizlet, to support the learning of 1SAP? 

2.1. The setting 

The Italian language and Culture I course is a four-hour per week, six-credit ISAP 
course. Its primary goal is to provide the basic communicative skills to students and 
to enable them to respond to basic daily needs, socially and for specific academic 
purposes, both orally and in writing. The use of new technologies is an integral part 
of the learning process. 

2.2. Students 

The participants were 16 students (13 female and three male), four students were 
17-19 years old, nine students 20-22 years old and two students 23-25 years old. 
Students had Greek as their mother tongue and English as their second language. 
None of them had any prior knowledge of Italian. They studied different fields: 
Management and Economics (three students); Communication and Internet 
Studies (six); Engineering and Technology (three); Geotechnical Sciences (two); 
and Environmental Management (two). 

2.3. The activities 

Based on Parmaxi and Zaphiris’s (2015) social constructionism framework, 
students worked and constructed new knowledge through continuous interaction, 
ideas sharing, and cooperation in groups. The result of this interaction was a 
vocabulary collection for each group which summarises their knowledge of ISAP. 
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Parmaxi and Zaphiris’s (2015) social constructionist framework involves three 
dimensions and nine actions: 

• exploration of ideas: orientation, brainstorming, material exploration; 

• construction of artifacts: outlining, editing material; 

• evaluation of artifacts: revising, peer reviewing, instructor reviewing, 
presenting/publishing. 

Students were divided in subgroups based on their field of study (Management and 
Economics, Communication and Internet Studies, Engineering and Technology, 
Geotechnical Sciences, and Environmental Management). The five sub-groups 
contributed to the building of the learning process; they created academic 
vocabulary collections related to their field of study and related profession using 
Quizlet. One 90-minute lesson was fully dedicated for each one of the five different 
academic fields of study groups. 

Following the constructionist aspirations, knowledge was not presented and 
imposed to the students by an expert, such as a teacher (Parmaxi & Zaphiris, 2014), 
instead, students created and co-constructed collaboratively their knowledge in 
the form of an artifact, an ISAP vocabulary collection. After being introduced to 
the tool ( Quizlet ) and the activity, they were prompted to brainstorm in groups, 
explore relevant material (online and/or offline), collaboratively outline and edit 
the material, and conclude in revising, reviewing and presenting their artifact to the 
group, following the social constructionist framework. 

2.4. The instruments 

The instruments used were two focus groups and a final questionnaire. 


3. Results 

For the construction of their artifact, students initially met to decide which words 
were important to be included in their ISAP vocabulary collection, searched terms 
and then found their meaning in Google Translator and other online dictionaries; 
finally, they inserted the terms in Quizlet. The groups consisted of two to six 
students. This was based on their field of study. Two groups followed the procedures 
given to them. However, some differentiations were noted in the rest of the groups: 
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in the three member groups, only one person of the group inserted the words in 
Quizlet (in other groups all students added words in their Quizlet online collection); 
in the six member group, due to its size, each student conducted a smaller research 
in order to reach the word limit for the creation of the vocabulary. One group used 
Google Docs as well before inserting the terms in Quizlet just to keep a record of 
each person’s contribution. The three dimensions and how they were applied in 
combination with Quizlet are presented in Figure 1. 


Figure 1. The three dimensions and how they were applied in the present research 
using Quizlet 


Exploration of ideas 

1. Quizlet was introduced to the students during a tutorial. Students were 
divided into 5 groups; they created accounts in Quizlet. 

1. Orientation 

2. Students engaged in an initial brainstorm ing; its outcome was the 

2. Brainstorming 

gathering of some important terms. 

3. Material exploration 

3. Students collected more terms with the use of the web, books, etc. In 
that way, they were engaged in a more in depth research. 


Construction of 
an artifact 


l.Outiining 
2. Editing Material 


1. Students gathered all the terms (80 per group) and started organising the material, 
using other tools as well (Google Translator, Google Docs). 

2. Students inserted the terms in Quizlet. They created a full version of their 
vocabulary and they continued editingtheir material. 


Evaluation of an artifact 

1. Students revised their artifacts: they corrected theirterms, used 
vocabularies and correctors. 

1. Revising 

2. The instructor revised every vocabulary in Quizlet by correcting, 
deletingterms before the publication. 

2. Peer reviewing 

3. The vocabularies were published through a link in facebook and 

3. Presenting/Publishing 

then in Quizlet. 


With regards to the difficulties that students encountered during the social 
constructionist approach, two out of the five teams reported that they only found 
difficult translating ISAP terms; the two member team stated that because they 
were only two, they had to do more work regarding the material they had to gather, 
and the terms they had to find; two teams reported that they faced no problem at all. 
Two teams stated that due to the fact that they were smaller groups (two or three 
persons), it was more convenient for them - even though they worked more, they 
worked better. 

Overall, students replied positively to the activity as it allowed them to find the 
words themselves and construct their knowledge of the vocabulary. This fostered 
students’ knowledge in their specific fields of study; students found conducting the 
specific research with this method and the use of technology more interesting. The 
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knowledge of the ISAP vocabulary made the student’s learning of the specific fields 
easier. Students also highlighted the importance of the intervention of the instructor 
at the end of the group work. Finally, students valued the cooperation between the 
members of the team and the group work as a way to improve themselves in ISAP. 


4. Discussion and conclusion 

This study presented the implementation of a social constructionist approach for 
developing an artifact with the use of Quizlet that aimed to develop students’ 
vocabulary in ISAP through sharing ideas, constructing and evaluating knowledge. 
The findings regarding students’ attitude towards the implementation of the social 
constructionist framework (i.e. exploration, construction, and evaluation) indicated 
positive results. According to students’ responses, they appreciated the three-step 
process, the independent learning nature of the activity, the collaborative group 
work, and the use of the particular technology (Quizlet). Students stated that their 
learning was motivated by this activity. Moreover, they stated that they did not 
only understand the vocabulary related to their field of study better, but also that of 
other academic fields. Finally, the findings were consistent with those of Parmaxi 
and Zaphiris (2015), demonstrating that the students appreciated the process and 
the steps followed. 
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Abstract. This study aims to develop and evaluate a language learning system 
supported by the ‘flipped jigsaw’ technique, called ‘Flip-J’. This system mainly 
consists of three functions: (1) the creation of a learning material database, (2) 
allocation of learning materials, and (3) fonnation of an expert and jigsaw group. 
Flip-J was developed as the plugin of the learning management system Moodle, 
and the formative evaluation for its improvement was conducted in a language 
learning class. Learners were required to answer an open-ended questionnaire on 
the usability of Flip-J after three weeks of flipped jigsaw classes, and the instructor 
was interviewed by the researcher. The results highlighted several areas for 
improvement, such as ‘unfriendly interface of discussion plugin’ and ‘translation 
function’, which will be incorporated in forthcoming classes. The instructor 
pointed out issues such as the learners seemed to face difficulties in using the 
discussion plugin and role management in Flip-J. 

Keywords: flipped learning, jigsaw method, open educational resources, 
instructional design. 


1. introduction 

The flipped class has gained international attention as an effective method of 
language teaching; it uses a blended learning design with online learning materials 
to enhance learning engagement in face-to-face classes (Sams & Bergmann, 
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2013). It has been employed in English as a Foreign Language (EFL) learning with 
positive results (e.g. Engin, 2014; Fraga & Harmon, 2015). In language learning, 
it is desirable that instructors and learners acquire the necessary knowledge 
and vocabulary prior to face-to-face classes. However, several issues with the 
implementation of flipped classes have been pointed out. For example, learners 
do not watch the required video prior to the class (Sams & Bergmann, 2013). 
Therefore, a flipped class design that enhances learning engagement should be 
considered for effective and efficient face-to-face classes. 

The jigsaw collaborative learning approach can be one of effective instructional 
approach for the enhancement of learning responsibility and interaction. The 
jigsaw collaborative learning approach consists of two phases; expert and jigsaw 
phases. First, the discussion topic was presented to students. For expert phase, 
students are divided into several groups, with each group assigned a different 
perspective of critical points of the discussion. Students usually study the material 
individually. Therefore, students confirm their understanding of each other, and 
discuss the theme in order to deepen their idea as ‘experts’ of the theme. After 
the expert phase, they move to the jigsaw phase. Students discuss the theme with 
different members of the expert group. They first introduce the contents that they 
studied, and discuss the topic. After the jigsaw phase, they are required to share 
their idea with all classmates. When the jigsaw collaborative learning approach 
was used to encourage quality interactions and promote higher-order thinking 
to improve the students’ learning engagement, positive effects on learning were 
reported in different subjects, from elementary to graduate school (Aronson & 
Patnoe, 2011). This is a helpful method for EFL students who lack confidence in 
speaking in English; this method helps them develop enough confidence to discuss 
their assigned expert topic with a jigsaw group and speak in English successfully. 
In this study, the flipped class and jigsaw approaches were merged to create the 
flipped jigsaw collaborative learning approach (or ‘flipped jigsaw’). 

Goda et al. (2015) reported on the practice of employing flipped jigsaw activities 
in EFL education. The results showed that many students found the study for 
English practice taxing with this learning approach, although their expectations 
of their English skill improving were also high in general. However, preparing 
for this approach seems to take a lot of time and instructors feel that the 
workload, which includes preparing for group formation and re-formation in 
case the learners are absent and/or do not submit their homework, is high. This 
study aims to develop a language learning support system called Flip-J that 
supports the flipped jigsaw class design, and to evaluate its usability in language 
learning classes. 
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2. System functions 

The system is a web-based application that uses the plugin for the learning management 
system Moodle. Flip-J has three functions: creation of a learning material DataBase 
(DB), allocation of learning materials, and formation of an expert and jigsaw group. 
First, using the learning material DB, instructors can register information (URL, 
starting time, description, and metadata) on open educational resources such as 
YouTube and Voice of America videos that are free to use for teaching. They can 
reuse and share these learning materials with other instructors. Second, under 
allocation of learning materials, instructors can set the homework as an expert group 
activity. The instructor sets the number of expert groups (topic) and team members 
in each expert group. If the instructor sets three expert groups and there are four 
team members in each group, the instructor has to prepare for three types of learning 
materials in the DB. The instructor provides information about the homework using 
the learning material DB. Thirdly, in the formation of an expert and jigsaw group, 
students are automatically assigned to expert and jigsaw groups for both virtual and 
face-to-face classes, based on their homework for the expert group activity submitted 
to Flip-J and the number of members set by the instructor. The instructors can change 
the members assigned to a group even after the automatic group formation. When an 
instructor finds that students are absent or identifies students who do not complete 
their homework, he/she can modify the group by using the drag-and-drop function 
on the user-friendly interface. Students who did not finish homework are required 
to study their homework for expert phase, because they cannot explain their ideas, 
and contribute to expert and jigsaw discussion without the accomplishment of their 
homework. Sample interfaces are shown in Figure 1. 

Figure 1. Interface of Flip-J: learning process and task submission deadline 



A Task submission deadline 

' --— *----— '—- HOME Moodle 
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3. Methods 

94 university students (female: 7, male: 87; all students were in the second year, 
and belonged to the School of Engineering) and one professor participated in the 
formative evaluation. The instructor designed the class for language learning using 
Flip-J. After the classes were over, students were required to answer the open- 
ended questionnaire on the usability of Flip-J, and researchers interviewed the 
instructor in order to identify areas for improvement. 

The design and implementation of the flipped jigsaw approach followed the study 
by Goda et al. (2015). Three in-class and two out-of-class activities were embedded 
in the design for three weeks. In the first week, students received instructions 
regarding the procedure and the purpose of the activities. One of the three video 
clips was randomly assigned to each student, and the students would then act as 
experts on the content assigned to them. The students were required to submit 
Assignment 1, wherein they answered four open-ended questions regarding the 
video, through Flip-J. 

Assignments were due the day before the next class. This forced each student 
to prepare for the expert discussion - and, further, for the jigsaw discussion - 
during the next class session. The discussion topic in the jigsaw group was as 
follows: ‘What skills, knowledge, and attitudes should be acquired in the 21st 
century? Flow can we effectively and efficiently learn new things in our modern 
society? Compare and contrast the traditional and new education methods’. 
The video clips had been selected by the instructor from open educational 
resources such as YouTube. These videos showed content pertinent to the 
jigsaw discussion. 

In an expert group discussion, three to four students who watched the same 
video were assembled, and confirmed their understanding of the video content 
for 20 minutes with each other. 

Following this, students were asked to revise their answers in Assignment 1. Then, 
three students from different expert groups were organized into jigsaw groups. 
The students in the jigsaw groups were instructed to share their findings and 
understanding of the assigned video content and were asked to discuss the topic 
for 40 minutes. They were then instructed to submit Assignment 2, a report of the 
topic in third class, via Flip-J by the next class session. During the class in the third 
week, reports submitted as Assignment 2 were peer reviewed, and the students 
presented their thoughts on the topic to the class. 
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4. Results 

31 out of 94 students answered the questionnaire about Flip-J after the third class. 
They understood the flow of the learning activity and completed the tasks via Flip-J. 
Above all, learners recognized that the Flip-J interface was highly accessible (ten 
learners) and user-friendly overall (six learners). 15 learners answered that they 
enjoyed communicating with acquaintances. The learners identified several areas 
for improvement to this system: (1) feature to adjust speech speed on embedded 
movie players (seven learners), (2) the function of the caption translation into native 
language (three learners), and (3) the interface of a discussion plugin, which was 
installed as a default Moodle plugin (19 learners). The instructor also suggested 
improvements in function: adding role management, which allows instructors 
to check the learning materials assigned to learners, and improving a discussion 
forum that was installed as a Moodle plugin and which the learners found difficult 
to use. In the latter, the learners could see the discussion forum of all groups, but 
had to reload the forum board when other learners posted. 


5. Conclusions 

In this study, we developed a language learning system supported by the flipped 
jigsaw technique, called Flip-J. We also conducted a formative evaluation of the 
technique using an open-ended questionnaire and an interview with the instructor. 
The results of the formative evaluation indicated that Flip-J can support learning 
behaviors in language learning, but has several areas for improvement, such as 
discussion forum and role management. We will improve the functions identified 
in this formative evaluation and re-evaluate the effects of this system from the 
viewpoint of the learning community (Yamada & Goda, 2012). 
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Abstract. In a design-based research approach (Barab & Squire, 2004), we are 
currently developing the first prototype of a collaborative Language for Specific 
Purposes (LSP) website. It focuses on technical vocabulary to help students 
master any field of LSP better. “Check Your Smile” is a platform aggregating 
various types of gameplays for each of which games are generated, based on the 
content of a collaboratively-constructed/user-generated multilingual dictionary. 
To this day the platform integrates six lexical games. In addition, “Check your 
Smile”, as a prototype of a new platform itself, has been selected as an Initiative 
of Excellence Project from the University of Toulouse in France. In a context of 
digital game-based learning, and as games, gaming and playing have become one 
of the main trends in educative innovation, we first justify the choice of a digital 
game-based learning solution. Then, we present the methodology followed for the 
development of “Check your Smile” and describe the linguistic and collaborative 
objectives. Finally, we conclude by presenting the potential future evolutions of 
our platform, as the release candidate version will be accessible from early 2017 
onwards. 

Keywords: language service provider, game-based digital learning, collaboration, 
technical vocabulary, Web 2.0, user-generated content, vocabulary learning. 
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1. Context and choice of a digital 
game-based solution 

In France, it is mandatory to study at least one foreign language at university, 
whatever the student’s major might be. This may directly impact how students 
view language learning and how (un)motivated they are to learn a foreign 
language (Dornyei, 2009). The recent literature shows the positive impact of 
digital game-based solutions on motivation (e.g. Oblinger, 2004; Papastergiou, 
2009; Sharpies et al., 2013), hence our choice to develop a game-based 
collaborative platform. Besides, university language teaching for students is not 
always adapted to their future linguistic needs in the professional world, which 
sometimes also contributes to a lack of motivation, hence our choice to focus 
on technical vocabulary learning. For the past 20 years in France, several LSP 
teacher associations and research groups (such as the GERAS research group 
for English for specific purposes, www.geras.fr/) have promoted research in 
LSP and have contributed to the development and teaching of LSP, showing the 
positive impact it has on students’ motivation and students’ preparation to their 
professional life (Van Der Yeught, 2014). The construct of LSP didactics and in 
particular of a theoretical framework is still being developed in France (see Sarre 
& Whyte, 2016). This reveals an increasing concern for LSP which is of course 
not limited to terminology but also involves a specific syntax, abbreviations and 
neologisms for instance. Flowever, in order to both facilitate the professional 
integration of French students and potentially help increase their motivation to 
learn LSP vocabulary which is linked to their field of study, we have decided 
to focus on specialized vocabulary learning as a complementary tool to LSP 
classes. Indeed, vocabulary is seen as a basic but essential tool without which a 
specialized technical discourse cannot be built. In a context where Web 2.0 has 
set the ground for large scale collaborative work, we are currently developing 
the first multidisciplinary and multilingual platform in France called “Check 
your Smile” which harnesses the scientific and academic terms of all specific 
purposes to be acquired by the students. Furthermore, as games, gaming and 
playing have become one of the strong trends in educative innovation in general 
(Sharpies et al., 2013) and in language learning in particular (Cornillie, Thome, 
& Desmet, 2012), we have adopted a digital game-based learning approach to 
hopefully trigger and/or sustain the motivation of our students, which is one of 
the effects of using games in learning (Oblinger, 2004; Papastergiou, 2009). To 
do so, we have adapted Thiagi’s (n.d.) recent Four Door model 6 and designed 
three different spaces on the platform: (1) the library (we called it Dictionary) 


6. For a visual presentation of Thiagi’s Four Door model, see https://liquidinteractive.files.wordpress.com/2013/02/four-doorsl .jpg 
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which is an online user-generated dictionary; (2) the playground (we called it 
Games ) where all the games are; and (3) the social interactions part which is 
what we called Community: this is the space where you can vote on (i.e. assess) 
other players’ submissions and/or complete other players’ submissions. The six 
current games range from audio crosswords to a taboo-like game 7 or a hangman¬ 
like game; our objective is to allow the student to work on listening and reading, 
as well as on writing and speaking which are traditionally more difficult to assess 
in a digital context. However, the integration of games into the learners’ activity 
is not the sole object of our system. Based on the works of Kim (2008), who 
stresses the importance of collaborative tasks to promote the acquisition of L2 
vocabulary, we assume that students will be more involved, as they take part in 
the content generation process, which in itself can also be motivating (Kessler, 
2013). This hypothesis will be tackled during the user tests and after the release 
of Version 1 next January, using Rabardel’s (1995) concept of ‘Instrumental 
genesis’ to consider this platform in the context of its future use. 


2. History, methodology and objectives 

“Check your smile” was originally designed in a specific Content and Language 
Integrated Learning (CLIL) set of classes from a computing department where 
students had to take computing, maths and economics classes in English, in 2013. 
Its name stems from this original CLIL experience then called SMILE. It was 
initially an extra tool in this learning environment. Today, even though the scope 
has changed as it is meant to be both multidisciplinary and multilingual, the name 
remained the same. In 2014 and 2015, an interuniversity and interdisciplinary 
team was set up to rethink a new version of “Check your Smile”. It comprised 
11 schools and universities, four sites and about 80 people from the University of 
Toulouse, in addition to national and international collaborations. Then, “Check 
your Smile” was selected in late 2015 as an Initiative of Excellence Development 
Project from the University of Toulouse in France (http://www.univ-toulouse.fr/ 
node/11538). The budget granted early 2016 allows us to redevelop the former 
2013 prototypal version in a more professional way, and to experiment with it 
on our students. 

Our international team now collaborates in gathering lexical corpora for specific 
purposes in different languages (such as French, English, Spanish, or Chinese) 
and in different fields (such as mechanical engineering, law or design). We first 


7. For a presentation of the game ‘Taboo’, see https://en.wikipedia.org/wiki/Taboo_(game) 
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started by breaking down into categories and subcategories the different fields 
and subfields studied at the University, using both universities’ online courses 
presentations and teachers’ feedback. 

Our categorization currently comprises more than 400 subfields or technical 
specialties (e.g. databases) for about 40 fields of study (e.g. computer science). 
Our team then used this material in the process of providing lexical entries, for its 
categorization. This step of the project is particularly important in order to obtain 
a first lexical corpus rich enough to play on the platform at its release, before any 
further vocabulary can be collaboratively built. This first version of the platform 
database will then contain entries submitted by our team, as well as science 
vocabulary from an online corpus called Lexico-Science (http://lexico.unisciel.fr/) 
whose owners generously agreed for us to use in our project. 


3. Future work 

User tests have already started and the platform will soon be available at the 
following address: www.checkyoursmile.fr. In the long term, we hope to develop 
new games, some of which in collaboration with the Innovalangues 2012-2018 
1DEFI Project (Masperi & Quintin, 2014). More generally, we are currently aiming 
at developing new sets of games based on mimes, gestures and imitation through 
the use of a webcam. We are for instance exploring the possibility of integrating 
gesture recognition in the platform as it has been demonstrated that hand gestures 
facilitate the acquisition of L2 vocabulary (e.g. Pavelin, 2002). 


4. Conclusion 

Cognitive ergonomics literature has taught us that no matter how innovative a 
tool is, it only starts to exist when it is used, i.e. to properly analyze a tool (or 
instrument), one needs to consider it in the context of its actual use (Rabardel, 
1995). As a follow-up research study, we have assumed so far that students will 
be more involved and thus more motivated: as we said, this is a user-generated 
content database. Given that the use of the platform is part of the teaching scenario, 
the students will have to take part in the generation process of the content. This 
hypothesis will be tested in the near future, once the new version platform is up 
and running. Following research questions are thus inherent to computer assisted 
language learning; not whether an invention works but rather in which contexts it 
works or does not, and how and why (e.g. Betrancourt, 2011). 
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With EUROCALL reaching its 23 rd year, it has truly earned its status 
as an innovative conference with a mind of its own - 
a thought-provoking scientific gathering with high aspirations for 
the future. This is what we have tried to reflect in this volume 
of short papers. Short papers are an ideal forum for work in progress 
and late breaking results. As such, this volume captures exactly 
what CALL communities and culture represent: papers that are all trying 
to say something new and different, whether at a theoretical 
and practical level or in terms of research carried out 
in non-traditional areas or using novel methodologies. 
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(Enjoy reading these papers!) 

Salomi Papadima-Sophocleous 
Conference chair of EUROCALL 2016 
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